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ABSTRACT 


The  purpose  of  this  thesis  is  to  provide  a  methodological  approach  for  conducting 
a  Business  Case  Analysis  (BCA)  for  the  Advanced  Technology  Ordnance  Surveillance 
(ATOS)  Advanced  Concept  Technology  Demonstration  (ACTD).  This  study  provides  a 
methodology  for  comparing  the  cost  savings  over  time  of  having  an  ATOS  infrastructure 
in  place  at  Navy  Munitions  Management  locations  compared  to  the  base  case  of  “as-is” 
inventory  management. 

ATOS  is  a  Radio  Frequency  Identification  (RFID)-based  automated  system  that 
provides  a  capability  to  collect  environmental  data  in  near  real-time  and  supports 
munitions  management  tasks  on  stored  munitions  pallets.  This  type  of  data  has  never 
before  being  available  and  is  critical  for  Ordnance  Managers  and  warfighters  in  making 
more  effective  decisions  about  the  shelf  life  and  operational  performance  of  individual 
munitions  throughout  their  service  life.  ATOS  is  not  meant  to  be  a  replacement  for  the 
status  quo  processes  of  Ordnance  Management  (OM).  Instead,  ATOS  is  meant  to 
enhance  many  of  the  current  processes  and  add  additional  capabilities  and  dimensions  to 
OM. 

A  Business  Case  Analysis  for  a  notional  site,  using  exemplar  data  sets  indicates 
that  with  an  initial  investment  of  $1.3M,  a  Net  Present  Value  (NPV)  of  $5.3M  can  be 
obtained  over  a  10-year  period.  The  payback  period  is  less  than  one  year,  and  the  Return 
on  Investment  is  214  %,  or  almost  1 1  %  annual,  compounded  ROI. 
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EXECUTIVE  SUMMARY 


The  purpose  of  this  thesis  is  to  provide  a  methodological  approach  for  conducting 
a  Business  Case  Analysis  (BCA)  for  the  Advanced  Technology  Ordnance  Surveillance 
(ATOS)  Advanced  Concept  Technology  Demonstration  (ACTD).  This  study  provides  a 
methodology  for  comparing  the  cost  savings  over  time  of  having  an  ATOS  infrastructure 
in  place  at  Navy  Munitions  Management  locations  compared  to  the  base  case  of  “as-is” 
inventory  management. 

ATOS  is  a  Radio  Frequency  Identification  (RFID)-based  automated  system  that 

•  Provides  a  capability  to  collect  environmental  data  in  near  real-time,  and 

•  Supports  munitions  management  tasks  on  stored  munitions  pallets. 

These  types  of  data  have  never  before  being  available  and  are  critical  for 

Ordnance  Mangers  and  warfighters  in  making  more  precise  predictions  about  the  shelf 
life  and  operational  performance  of  individual  munitions  throughout  their  service  life. 
ATOS  is  not  meant  to  be  a  replacement  for  the  status  quo  processes  of  Ordnance 
Management  (OM).  Instead,  ATOS  is  meant  to  enhance  many  of  the  current  processes 
and  add  additional  capabilities  and  dimensions  to  OM. 

With  the  assistance  of  Subject  Matter  Experts  (SMEs)  from  Naval  Surface 
Warfare  Center  (NSWC),  Indian  Head  Division,  a  Work  Breakdown  Structure  (WBS) 
with  Cost  Estimates  (CEs)  for  the  implementation  of  an  ATOS  infrastructure  was 
generated.  These  cost  estimates  were  used  in  calculations  to  determine  the  “as-is”  and 
the  “to-be”  inventory  costs.  These  costs  were  used  in  a  Business  Case  Analysis  to 
determine  the  potential  cost  savings  and  benefits  of  implementing  an  ATOS 
infrastructure  at  a  notional,  five  magazine  munitions  site,  which  is  meant  to  be  analogous 
to  Navy  Munitions  Management  locations. 

This  Business  Case  Analysis  methodology  only  provides  cost  savings  for  this 
notional  base  case.  In  order  to  provide  realistic  cost  savings  with  a  greater  degree  of 
accuracy,  a  pilot  program  has  been  scheduled  for  later  this  year  to  assess  further  the 
benefits,  including  cost  impacts,  of  the  ATOS  technology. 


xvii 


A  Business  Case  Analysis  for  a  notional  site,  using  exemplar  data  sets  indicates 
that  with  an  initial  investment  of  $1.3M,  a  Net  Present  Value  (NPV)  of  $5.3M  can  be 
obtained  over  a  10-year  period.  The  payback  period  is  less  than  one  year,  and  the  Return 
on  Investment  is  214  %,  or  almost  1 1  %  annual,  compounded  ROI. 

To  validate  the  cost  estimates  used,  a  full  scale  ATOS  pilot  project  at  a  munitions 
location,  such  as,  Seal  Beach,  needs  to  be  funded  and  implemented  in  order  to  collect  the 
required  data  to  validate  the  results  from  previous  analysis,  and  support  and  provide  a 
better  argument  as  to  why  ATOS  is  the  way  to  go  in  Ordnance  Management. 

Additionally,  in  order  to  establish  an  ATOS  implementation  plan  DoD  wide,  a 
study  on  optimizing  the  placement  of  ATOS  needs  to  be  initiated.  The  optimization  will 
account  for  both  where  ATOS  should  be  implemented,  as  well  as  a  time  phased  approach 
to  the  implementation.  These  analyses  will  help  decision  makers  in  determining  the 
optimal  locations  that  provide  the  greatest  savings  due  to  the  large  munitions  stockpiles. 
For  example,  small  munitions  facilities  where  munitions  do  not  have  a  high  cycle  rate 
may  not  be  a  high  priority  for  the  implementation  of  ATOS. 

Finally,  the  RFID  tags  chosen  to  be  attached  to  munitions  pallets  need  the 
capability  to  collect  the  environmental  data  that  is  required  by  QE  personnel  to  input  into 
models  to  provide  Ordnance  Managers  valuable  information  about  the  status  of  their 
munitions  in  inventory. 


I.  INTRODUCTION 

A.  PURPOSE  OF  THIS  STUDY 

The  purpose  of  this  thesis  is  to  analyze  the  potential  cost  savings  and  benefits 
associated  with  the  implementation  of  an  Advanced  Technology  Ordnance  Surveillance 
(ATOS)  infrastructure  at  Navy  Munitions  Management  locations.  ATOS  will  provide 
ordnance  managers  the  ability,  on  a  near  real-time  basis,  to  locate  accurately  and  to 
determine  continuously  the  environmental  status  of  high  value,  low  density  munitions  on 
a  near  real-time  basis  while  also  updating  predictions  of  the  future  condition  and 
performance  of  the  ordnance.  In  the  future,  a  Navy  Munitions  Management  location  will 
be  selected  to  initiate  a  pilot  program  to  assess  and  validate  the  benefits  of  the 
technology.  This  study  provides  a  methodology  for  comparing  the  cost  savings  over  time 
of  having  an  ATOS  infrastructure  in  place  compared  to  the  base  case  of  “as-is”  inventory 
management. 

ATOS  was  chosen  for  this  thesis  for  two  reasons: 

•  Importance  to  the  Deputy  Under  Secretary  of  Defense  (DUSD)  due  to 
its  high  visibility  in  the  DOD  RFID  policy. 

•  Example  of  the  process  by  which  a  project  transitions  from  an 
Advanced  Concept  Technology  Demonstration  (ACTD)  in  technology 
base  to  a  program  of  record  in  the  DOD  5000  Acquisition  System. 


1.  Potential  Cost  Savings  and  Benefits 

The  promise  of  an  ATOS  infrastructure  for  the  ordnance  manager  is  that  it  can 
provide  continuous,  comprehensive,  and  real-time  visibility  of  current  inventories.  Real¬ 
time  visibility  enables  ordnance  managers  and  ammunition  site  managers  to  avail 
themselves  of  the  following  potential  benefits: 

•  Reduce  inventories  using  more  accurate  data  about  supply  and  demand 
of  ordnance. 

•  Reduce  out-of-stocks  based  on  minimum  thresholds 
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•  Provide  a  foundation  for  event-driven  optimization  to  enable  the  re¬ 
optimization  of  the  supply  chain  logistics  when  a  problem  occurs,  e.g., 
an  airplane  carrying  munitions  to  the  theater  breaks  down. 

•  Reduce  manual  inventory  management  tasks,  thereby  reducing  human 
errors  and  freeing  up  labor  to  be  reallocated  to  more  mission-critical 
activities 

•  Identify  and  reduce  shrinkage  across  the  munitions  supply  chain 

•  Improve  efficiencies  within  munitions  warehouses  by  reducing  time 
spent  searching  for  specific  items 

•  Improve  asset  management  and  more  accurately  validate  physical 
inventory  with  accounting  data 

•  Improve  responsiveness  to  munitions  recalls  through  greater 
specificity,  which  will  pinpoint  exactly  which  lots  of  items  need  to  be 
returned  and  where  to  find  them 

•  Maintain  or  extend  munitions  shelf  life  due  to  timely  preventive 
maintenance  or  calibration 

•  Avoid  having  to  replenish  stolen  or  misplaced  items  since  an  RFID  tag 
can  be  integrated  to  an  alarm  system 


B.  WHAT  IS  RFID? 

Radio  Frequency  Identification  is  an  Automatic  Data  Collection  (ADC) 
technology  that  uses  radio  frequency  waves  to  transfer  data  between  an  RFID  reader  and 
an  item  of  interest  to  which  an  RFID  device  (tag)  is  attached  in  order  to  identify  it, 
categorize  it,  and  track  it.  Compared  to  the  “as-is”  inventory  management  system,  RFID 
can  greatly  reduce  the  time  to  conduct  an  inventory  because  it  is  fast,  reliable,  and  does 
not  require  line  of  sight  or  contact  between  the  RFID  reader  and  the  RFID  tagged  item. 
This  non-line  of  sight  physical  characteristic  means  that  tags  can  be  read  through  a 
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variety  of  RF  propagation  media,  to  include  fog,  snow,  dirt,  grime,  and  other  visually  and 
environmentally  challenging  conditions.  In  these  conditions,  barcodes  or  other  optically 
read  technologies  would  be  useless. 

Present  technology  allows  RFID  tags  to  be  read  at  very  high  speeds,  even  in 
adverse  weather  conditions  responding  in  less  than  100  milliseconds  [SAVI  2005],  Due 
to  its  capability  and  reliability,  RFID  technology  has  been  adopted  in  a  wide  range  of 
automated  data  collection  and  identification  applications  that  would  not  be  possible 
otherwise. 

1.  RFID  Characteristics 

There  are  six  important  characteristics  of  RFID  that  impact  the  transfer  of  data 
between  a  tag  and  an  RFID  reader:  range,  range  adjustment,  propagation,  directionality, 
multi-tag  collection,  and  memory  [SAVI  2005]. 

a.  Range.  Range  is  defined  as  the  maximum  distance  for  a  successful 
communication  between  the  RFID  tag  and  RFID  reader.  RFID 
technology  allows  RFID  readers  to  communicate  successfully  with 
RFID  tags  in  either  of  the  following  ranges: 

•  Very  short  range:  Up  to  60  centimeters  (two  feet) 

•  Short  range:  Up  to  five  meters  (16  feet) 

•  Long  range:  Greater  than  100  meters  (320  feet) 

Frequency  is  one  of  the  leading  factors  that  effects  range  of  a 
successful  tag-reader  communication  and  determines  the  type  of 
RFID  technology  that  should  be  used  for  a  specific 
implementation.  Low  frequency  systems  have  short  reading  range 
and  are  most  commonly  used  in  item  tracking  and  security  access 
implementations.  High  frequency  systems  offer  long  read  ranges 
and  high  reading  rate  and  are  commonly  used  for  railroad  car 
tracking  and  automated  toll  collection.  Table  1  below  displays 
common  RFID  frequencies  being  used  in  RFID  readers. 
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Frequency  Band 

Description 

Range 

125-134  KHz 

Low  frequency 

To  18  inches 

13.553-13.567  MHz 

High  frequency 

3-10  feet 

400-  1000  MHz 

Ultra-high  frequency  (UHF) 

10-30  feet 

2.45  GHz 

Microwave 

1 0+  feet 

Table  1.  Common  RFID  Frequencies  and  Passive  Ranges  (From  Ref.  Intermec 

Technologies  Corporation  2004). 


b.  Range  adjustment.  Range  adjustment  is  the  RFID  reader’s  ability 
to  automatically  adjust  the  range  at  which  it  is  being  operated.  Tag 
reader  communication  is  guaranteed  within  the  specified  range  of 
the  reader  and  tag-reader  communication  outside  the  specified 
range  is  impossible. 

c.  Propagation.  Propagation  is  the  ability  of  the  RFID  reader  to 
perform  tag-reader  communication  through  or  around  objects  and 
material.  With  very  good  propagation,  the  RF  can  penetrate 
through  items  allowing  successful  data  transfer  between  the  tag 
and  reader.  Having  good  propagation  enhances  the  penetration 
through  water,  liquids  or  human  tissue. 

d.  Directionality.  Directionality  is  the  ability  of  the  RFID  reader  to 
achieve  directional  RF  coverage  using  directional  antennas.  There 
are  two  types  of  directionality:  Omni-directional  and  Directional. 
Omni-directional  coverage  has  the  same  RF  intensity  (or  coverage) 
in  all  directions.  With  directional  coverage,  the  RF  intensity  is 
much  stronger  in  one  specific  direction. 

e.  Multi-tag  collection.  Multi-tag  collection  is  the  ability  of  the  RFID 
reader  to  process  more  than  one  tag  within  a  designated  area. 

f.  Memory.  Tags  range  from  small  memory  size  (16  bits)  to  large 
memory  (at  least  512  kilobytes).  Memory  is  an  important 
characteristic  in  RFID  communication  because  it  determines  the 
read  only  (passive  RFID),  read/write  (active  RFID),  or  write-once- 

read-many  capabilities  in  the  tag-reader  communication. 
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C.  HOW  DOES  AN  RFID  SYSTEM  WORK? 

Figure  1  shows  a  typical  RFID  configuration,  consisting  of 

•  one  or  more  RFID  tags, 

•  two  or  more  antennas, 

•  one  or  more  interrogators, 

•  one  or  more  host  computers,  and 

•  the  appropriate  software  to  transform  the  raw  data  into  useable 
information. 

In  a  basic  RFID  tag  operation,  radio  waves  are  used  to  transfer  data  between  the 
RFID  tag  (transponder)  and  the  read/write  device  (interrogator),  which  is  tuned  to  the 
same  frequency.  The  interrogator  sends  out  a  signal,  which  is  received  by  all  tags  that  are 
present  in  the  radio  frequency  (RF)  field  tuned  to  that  frequency.  Tags  that  receive  the 
signal  respond  by  transmitting  their  stored  data.  The  tags  can  hold  many  types  of  data 
about  the  item,  such  as  its  serial  number,  configuration  instructions,  what  time  the  item 
traveled  through  a  certain  zone,  temperature  and  other  data  provided  by  sensors. 


Tag 


Reader 


Figure  1.  RFID  System  Components  (From  Ref.  Intermec  Technologies  Corporation 

2004). 
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The  read/write  device  receives  the  tag  signal,  decodes  it  and  transfers  the  data  to 
the  host  computer  system. 

RFID  tags  can  be  attached  to  virtually  anything  -  from  an  airplane,  to  a  pallet,  to  a 
case,  to  an  item  stored  on  a  shelf.  If  multiple  tags  are  present  in  the  field  of  interrogation, 
more  efficient  RFID  implementations  have  anti-collision  algorithms,  which  determine  the 
order  of  response  so  that  each  tag  is  read  once  and  only  once. 


D.  ACTIVE  RFID  TAGS 

The  term  “active”  means  that  there  is  an  internal  battery  source  installed  in  the  tag 
to  provide  power  to  send  a  signal  on  demand.  Active  RFID  tags  are  wireless 
transponders  which  can  automatically  identify,  locate,  track,  monitor,  and  protect  a 
variety  of  items  of  interest.  Unlike  Global  Positioning  System  (GPS)  which  is  available 
worldwide,  active  RFID  only  operates  around  the  operation  site  where  the  RFID 
infrastructure  has  been  implemented.  Active  tags  can  be  activated  for  transmitting  when 
they  reach  a  particular  location,  or,  they  can  be  programmed  to  transmit  at  set  intervals, 
or  when  a  change  of  condition  occurs.  Changed  conditions  include  movement  or  sensor 
thresholds  such  as  temperature,  humidity,  shock  or  any  number  of  sensor  detections. 

Active  tags,  because  of  their  power  source,  also  have  the  ability  to  act  without  an 
external  activation,  thereby  providing  a  number  of  added  value  functions.  For  example: 

•  A  tag  can  be  configured  to  alarm  and  send  an  alert  signal  if  the  tag  is 
removed,  so  (anti-tamper)  active  tags  provide  a  security  solution  for  assets 
and  containers. 

•  Tags  equipped  with  a  motion  sensor  can  alarm  in  the  event  of 
unauthorized  inventory  movement. 

•  Beaconing  tags  can  provide  an  automatic  inventory  count.  Beacon  tags 
send  signals  to  a  receiver  at  pre-determined  time  intervals  to  provide 
continuous  monitoring  on  the  inventory  and  its  location. 
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1.  Active  RFID  Key  Capabilities 

In  an  August  2004  market  study  and  end  user  survey  by  Venture  Development 
Corporation  [Axcess  2005],  active  RFID  systems,  compared  to  the  passive  RFID 
inventory  management  systems  (i.e.,  non-active  RFID  systems)  were  found  to  have  a 
series  of  valuable  characteristics,  including  the  following: 

•  Enhanced  dependability  because  of  high  performance,  i.e.,  active  RFID  is 
continuously  emitting  RF  energy,  thereby,  providing  the  user  with  the 
latest  information 

•  Enhanced  security/access  control  including  theft  reduction 

•  Provided  the  ability  to  link  tags  together  in  software  for  custodianship 

•  Provided  the  ability  to  automate  identification  and  location  by  removing 
human  intervention 

•  Improved  the  accuracy  and  reliability  of  data 

•  Improved  read  accuracy  and  longer  read  ranges  than  passive  RFID 

•  Increased  data  transfer  rate 

E.  PASSIVE  RFID  TAGS 

Unlike  active  tags,  passive  RFID  tags  do  not  have  an  internal  battery  source. 
Passive  RFID  tags  rely  on  capturing  and  re-using  a  small  portion  of  the  wake-up  signal’s 
energy  to  transmit  its  RFID  tag  ID  and  other  information  back  to  the  receiver.  This 
requires  a  strong  RF  signal  from  a  reader  and  limited  available  energy  constrains  the  RF 
signal  strength  returned  from  the  tag.  For  this  reason,  passive  RFID  tags  can  only  operate 
over  very  short  ranges  and  requires  a  line  of  sight  for  successful  operation.  This  is  a 
“good  news,  bad  news”  situation  [Axcess  2005].  The  “good  news”  is  that  passive  tags 
can  be  manufactured  and  sold  at  much  lower  prices  than  active  tags  because  of  their 
capability.  This  can  be  a  critical  decision  point  in  many  RFID  supply  chain  applications 
requiring  literally  millions  of  tags.  The  “bad  news”  is  that  passive  tags  are  not  100% 
reliable  because  they  depend  on  a  small  amount  of  power  to  push  their  signal  off  metal 

surfaces  or  through  layers  of  palletized  items. 
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In  short,  active  tags  therefore  have  an  innate  performance  advantage  over  passive 
tags  when  it  comes  to  providing  a  consistently  robust,  penetrating  signal.  When 
activated,  active  RFID  tags  send  a  signal  capable  of  being  read  at  much  greater  ranges 
than  passive  RFID  tags. 

F.  DEPARTMENT  OF  DEFENSE  (DOD)  RFID  POLICY 

Mr.  Michael  Wynne,  Acting  Under  Secretary  of  Defense  (USD)  (Acquisition, 
Technology  and  Logistics  (AT&L)),  announced  a  new  RFID  policy  on  July  30,  2004 
within  the  DoD  [USD  2004],  The  DoD  requires  passive  RFID  tags  on  the  case,  pallet, 
and  item  packaging  for  Class  I  (subsistence  and  comfort  items),  Class  II  (clothing, 
individual  equipment,  and  tools),  Class  VI  (personal  demand  items),  and  Class  IX 
(weapon  systems  repair  parts  and  components)  commodities  delivered  on  or  after  January 
1,  2005.  For  about  two  years,  DoD  will  accept  Electronic  Product  Code  (EPC)  Class  0 
(read  only)  or  Class  1  (read/write)  passive  RFID  tags.  DoD  will  migrate  to  Ultra  High 
Frequency  (UHF)  Generation  2  tags  when  specification  is  finalized.  In  accordance  with  a 
white  paper  [Alien  Technology  Corporation  2005],  these  Generation  2  tags  will  be  the 
tags  of  the  future.  It  is  expected  that  Generation  2  tags  will  have  the  capability  to  read 
over  1,000  tags  per  second. 

The  following  excerpts  were  taken  from  a  November  12,  2005  article  in  New 
York  Times,  titled  “Military  To  Urge  Suppliers  To  Adopt  Radio  ID  Tags,”  reported  that 
the  Defense  Department  will  begin  prodding  suppliers  to  use  RFID  tags  on  cartons  and 
pallets  or  goods  entering  DoD’s  vast  supply  system. 

Further  paving  the  way  for  a  type  of  inventory  tracking  technology  that 
Wal-Mart  is  already  turning  into  a  commercial  standard,  the  Defense 
Department  on  Monday  will  begin  prodding  suppliers  to  use  radio¬ 
frequency  ID  tags  on  cartons  and  pallets  of  goods  entering  its  vast  supply 
system. 

The  tags,  meant  to  let  goods  be  tracked  without  the  proximity  and  line  of 
sight  required  by  bar-code  scanners,  have  vast  potential  for  military, 
homeland  security  and  commercial  applications.  But  just  as  Wal-Mart  is 
proceeding  in  steps,  starting  only  with  its  biggest  suppliers,  so  will  the 
military  adopt  the  radio  tags  in  stages. 
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The  new  program  will  initially  apply  only  to  a  range  of  combat-support 
goods  handled  by  the  Defense  Department's  two  largest  supply  centers: 
the  Susquehanna  depot  in  New  Cumberland,  Pa.,  and  the  San  Joaquin 
depot  in  Stockton,  Calif.  And  rather  than  adding  the  requirement  to 
existing  contracts,  the  military  will  make  it  a  proviso  of  new  or  renewed 
contracts. 

But  some  of  the  Defense  Department's  largest  suppliers  say  they  will  tag 
some  goods  headed  to  Susquehanna  and  San  Joaquin  even  before  new 
contracts  require  them  to  do  so. 

It's  a  critical  part  of  our  effort  to  support  the  war  fighter  and  we  want  to  be 
an  industry  leader,  said  George  Ellis,  who  oversees  radio-frequency  ID  at 
Raytheon,  which  has  also  been  testing  use  of  the  tags  to  track  goods  inside 
its  own  operations. 

While  giants  like  Raytheon  are  handling  the  tagging  of  military  goods 
themselves,  many  smaller  companies  are  using  outside  contractors  like 
SimplyRFID,  a  four-year-old  consulting  and  management  company  based 
in  Warrenton,  Va. 

"Our  traffic  is  up  significantly  in  the  past  two  weeks,"  said  Carl  Brown, 
president  of  SimplyRFID,  which  charges  customers  shipping  5,000  items 
or  less  to  the  military  roughly  $1  a  tag. 

Alan  Estevez,  the  Defense  Department  logistics  policy  specialist  who  is 
overseeing  the  program,  emphasized  the  gradual  phase-in  of  the 
technology.  "I'm  not  expecting  a  Big  Bang  on  Nov.  14,"  he  said. 

Even  so,  tens  of  thousands  of  the  Defense  Department's  estimated  60,000 
suppliers  could  come  under  its  requirements  within  a  year,  Mr.  Estevez 
said.  The  program  calls  for  adding  another  34  supply  centers  next  year  and 
the  rest  of  the  military's  distribution  operations  in  2007. 

Supporters  of  the  tagging  technology  said  that  the  military's  new  rules 
were  the  biggest  step  forward  for  radio  tags  since  Wal-Mart  Stores  began 
requiring  its  largest  suppliers  to  use  them  for  shipments  to  three 
distribution  centers  last  January.  Wal-Mart,  which  also  supported  the 
tagging  at  150  stores  served  by  the  distribution  centers,  has  since 
expanded  its  program  to  more  distribution  centers  and  500  stores,  with 
plans  to  double  that  number  early  next  year. 

In  theory,  the  tagging  will  eventually  wring  billions  of  dollars  in  waste  out 
of  supply  chains,  sharply  curtail  theft  and  counterfeiting,  and  reduce  the 
frequency  of  shoppers'  encountering  empty  shelves  instead  of  the  products 
they  want.  The  tagging  may  also  speed  customers  through  checkout  lanes 
because,  unlike  bar-code  scanners,  tag  readers  can  look  for  numerous 
products  with  a  single  signal. 
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In  practice,  though,  figuring  out  where  to  place  the  readers  and  the  tags  to 
get  data  reliably  has  proved  to  be  an  expensive  trial-and-error  process. 
Compared  with  the  military  supply  chain,  Wal-Mart's  distribution  system 
is  in  some  ways  more  difficult  to  manage  than  the  Defense  Department's 
because  goods  move  through  the  Wal-Mart  consumer  pipeline  so  much 
more  rapidly.  But  the  military  has  far  more  suppliers,  along  with  a 
complex  mix  of  new,  replacement  and  repaired  goods,  and  less  predictable 
demands  than  Wal-Mart's  seasonal  peaks. 

What  is  more,  "the  backroom  of  a  Wal-Mart  on  a  Saturday  afternoon  may 
be  hectic,  but  it's  not  like  a  mobile  supply  center  in  the  desert  that's  being 
shot  at,"  Mr.  Estevez  said.  The  military's  backing  gives  other  users  and 
investors  confidence  in  radio  tags,  said  Kevin  Ashton,  vice  president  of 
ThingMagic,  a  manufacturer  of  tag-reading  devices  based  in  Cambridge, 
Mass.  "You  have  to  give  people  the  sense  that  this  is  inevitable  to  have  the 
opportunity  to  work  out  the  details,"  he  said. 

The  details  have  been  a  challenge.  The  Defense  Department  and  private- 
sector  trucking  and  shipping  companies  have  plenty  of  experience  with 
battery-powered  tags  able  to  communicate  with  satellites  to  track  large 
containers  and  expensive  equipment. 

The  microchips  in  the  tags  now  being  introduced  by  the  military  and  Wal- 
Mart,  however,  rely  on  power  emitted  from  the  scanners  to  provide  the 
energy  the  tags  need  to  respond.  Plans  call  for  applying  these  "passive" 
tags  to  billions  of  items  before  the  end  of  the  decade. 

Researchers  at  the  University  of  Arkansas  reported  last  month  that  12 
Wal-Mart  stores  with  radio  tag  scanners  in  their  storerooms  were  able  to 
restock  shelves  at  three  times  the  speed  of  a  control  group  of  12  stores  that 
relied  on  traditional  methods  to  locate  stock.  The  tag  stores  were  16 
percent  less  likely  to  have  empty  shelves. 

Wal-Mart  hailed  the  study  as  proof  of  the  technology's  value.  But  it  did 
not  quantify  the  actual  savings.  And  AMR  Research,  a  consulting 
company,  concluded  from  a  survey  of  major  Wal-Mart  suppliers  that  it 
would  take  them  more  than  nine  years  to  earn  a  payback  on  their 
investments  at  current  tag  and  reader  prices  -  far  beyond  the  one-to-two- 
year  time  horizon  that  would  make  the  technology  financially  attractive. 

The  military  may  encounter  far  less  resistance.  Unlike  Wal-Mart,  the 
government  expects  to  shoulder  the  extra  costs  the  technology  imposes  on 
suppliers.  And  the  military's  goals  seem  less  likely  to  stir  up  opposition 
from  privacy  advocates  who  are  opposing  use  of  the  tags  in  commerce. 

"The  real  payback  for  D.O.D.  is  to  have  the  soldier  on  the  ground  have  the 
part  needed  to  make  a  tank  run  or  a  plane  fly,"  said  Mr.  Estevez. 
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G.  PREVIOUS  RFID  WORK  DONE  AT  THE  NAVAL  POSTGRADUATE 
SCHOOL  (NPS) 

There  have  been  four  Master  of  Business  Administration  (MBA)  professional 
reports  completed  at  NPS  that  researched  different  approaches  to  the  employment  of 
RFID  within  the  United  States  military. 

The  first  two  projects  considered  the  impact  of  active  RFID  in  the  supply  logistics 
chain.  There  is  a  current  focus  on  supply  logistics  chain  activities,  as  part  of  several  DoD 
initiatives  to  provide  total  product  visibility  of  all  cargo  movements  in  support  of  the 
troops. 

The  third  study  conducted  a  cost-benefit  analysis  of  implementing  an  active  RFID 
infrastructure  as  a  real-time  asset  management  tool  within  a  military  hospital. 

The  fourth  thesis  conducted  an  analysis  of  cost  and  benefits  associated  with  the 
implementation  of  an  active  RFID  infrastructure  at  a  maintenance  depot.  These  theses 
are  summarized  below. 

1.  USTRANSCOM  and  In-transit  Visibility 

This  NPS  thesis  was  completed  in  December  2003  [Hozven  2003]  and  focused  on 
the  Air  Mobility  Command  (AMC),  an  organization  under  the  United  States 
Transportation  Command  (USTRANSCOM)  which  is  accountable  for  all  military 
transportation  and  is  responsible  for  establishing  the  global  RFID  infrastructure.  The 
primary  objective  of  this  study  was  to  assess  the  potential  value  of  RFID  to  AMC  if  used 
in  its  worldwide  network  of  ports  to  manage  the  supply  logistics  chain.  The  study 
concludes  that  there  are  benefits  to  using  RFID  but  more  pilot  projects  are  needed  to  be 
implemented  to  fully  quantify  the  value  of  RFID  technology.  This  thesis  in  PDF  format 
can  be  accessed  at  the  following  link: 

http://stinet.dtic.mil/cgi-bin/GetTRDoc?AD=ADA420561&Location=U2&doc=GetTRDoc.pdf 


2.  Value  of  Supply  Chain  Logistics  Information 

This  NPS  thesis  was  completed  in  June  2004  [Corrigan  2004]  and  attempts  to 
quantify  the  value  added  by  using  RFID.  It  does  this  by  investigating  what  a  Supply 
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Officer  was  willing  to  pay  for  real-time  information  and  visibility  of  products  in  the 
supply  logistics  chain.  The  report  concludes  that  real-time  logistics  information  is 
valuable  in  order  to  effectively  support  the  warfighter.  Additionally,  the  thesis  noted  that 
RFID  offers  tangible  cost  savings  to  include  reduction  in  labor  costs,  as  well  as  intangible 
benefits  of  better  access  to  information  to  allow  for  better  management  decisions 
concerning  allocation  of  limited  resources.  This  thesis  can  be  accessed  in  PDF  format  at 
the  following  link: 

http://stinet.dtic.mil/cgi-bin/GetTRDoc?  AD= AD  A424676&Location=U2&doc=GetTRDoc.pdf 

3.  Management  of  Medical  Equipment 

This  NPS  thesis  was  completed  in  December  2004  [Sanchez  2004],  and  its 
primary  focus  was  to  identify  the  value  of  RFID  in  the  management  of  medical 
equipment  at  the  Naval  Medical  Center  in  San  Diego,  California.  The  study  concluded 
that  the  value  of  RFID  was  two  fold: 

•  Cost  savings  produced  by  the  elimination  of  replacement  costs  caused  by 
lost  equipment 

•  Increased  efficiency  in  manpower  utilization  by  avoiding  the  time  required 
to  find  lost  equipment. 

The  study  presented  a  Return  on  Investment  (ROI)  analysis  that  illustrated  a 
positive  Net  Present  Value  (NPV)  in  less  than  a  year  when  RFID  was  implemented  under 
the  study  conditions.  This  thesis  can  be  accessed  in  PDF  format  at  the  following  link: 

http://stinet.dtic.mil/cgi-bin/GetTRDoc?  AD= AD  A429394&Location=U2&doc=GetTRDoc.pdf 

4.  Management  of  Equipment  at  Tobyhanna  Army  Maintenance  Depot 

This  NPS  thesis  was  completed  in  June  2005  [Miertschin  2005]  and  its  purpose 
was  to  identify  the  potential  value  of  RFID  used  for  inventory  and  asset  management  at 
the  Tobyhanna  Army  Maintenance  Depot.  This  study  concludes  that  RFID 
implementation  proved  beneficial  to  increase  process  efficiency  and  reduce  the  number 
of  man-hours  expended  to  find  lost  or  misplaced  equipment.  This  study  “indicates  a  ROI 
of  less  than  one  year.  This  result  supports  other  research  conducted  on  RFID  as  an  asset 
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management  tool,  and  indicates  that  Tobyhanna’s  investment  in  advancing  technology 
essentially  paid  for  itself  within  one  year  when  measured  in  labor  cost  savings.  More 
importantly,  the  technology  yields  an  annual  savings  of  837  RCT  days.  Although  we 
could  theoretically  assign  a  monetary  value  to  the  RCT  savings,  we  believe  the  statistic 
adequately  reflects  the  savings  to  the  field.”  This  thesis  can  be  accessed  in  PDF  format  at 
the  following  link: 

http://librarv.nps.navv.mil/uhtbin/hvperion/05Jun%5FMiertschin%5FMBA.pdf 
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II.  BACKGROUND 


A.  ADVANCED  CONCEPT  TECHNOLOGY  DEMONSTRATION  PROCESS 

1.  Introduction 

Budget  constraints,  significant  changes  in  threats,  and  an  accelerated  pace  of 
technology  development  have  challenged  the  ability  of  the  Component  Commanders 
(COCOMs)  to  adequately  respond  rapidly  to  the  evolving  military  needs.  Part  of  the 
Department  of  Defense  response  to  thee  challenges  has  been  to  initiate  the  Advanced 
Concept  Technology  Demonstration  program  in  early  1994  to  get  new  technologies  into 
the  hands  of  the  warfighter  as  quickly  as  possible. 

The  ACTD  program  is  designed  to  assist  the  DoD  acquisition  process  adapt  to 
today’s  economic  and  threat  environments.  ACTDs  identify  significant  military  needs 
and  match  them  to  mature  technologies  or  technology  demonstration  programs  which  are 
maturing  key  technologies  in  order  to  solve  important  military  needs  (see  Figure  2). 
These  technologies  are  then  combined  and  integrated  into  a  complete  military  capability 
to  provide  decision  makers  an  opportunity  to  understand  fully  the  operational  potential 
offered  by  a  proposed  new  military  capability  before  making  an  acquisition  or 
sustainment  decision.  This  goal  is  met  by  developing  fieldable  prototypes  of  the 
proposed  capability  and  providing  those  prototypes  to  the  warfighter  for  evaluation  of 
that  capability.  The  warfighter  evaluates  the  capability  in  real  military  exercises  and  at  a 
scale  sufficient  to  assess  fully  military  utility.  During  the  ACTD,  the  warfighter  also 
evolves  the  broad  statement  of  need,  which  existed  at  the  start  of  the  ACTD,  into  a 
definitive  set  of  operational  requirements  that  can  support  a  follow-on  acquisition.  At  the 
completion  of  the  ACTD,  the  prototypes  used  in  the  evaluation  process  are  left  with  the 
warfighter  to  provide  an  interim  capability  or,  in  some  cases,  to  fulfill  the  total,  current 
need. 

Figure  2  below  displays  the  ACTD  Development  Process. 
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Figure  2.  ACTD  Development  Process  (From  Ref.  ACTD  2004). 


In  a  February  24,  2005  article  in  Inside  the  Pentagon,  titled  “DOD  Plans  New 
Acquisition  Executive  Post  To  Champion  Joint  Programs,”  plans  were  announced  on 
establishing  the  policies  for  ACTDs  and  JCTDs. 

The  Pentagon  plans  to  establish  a  new  acquisition  executive  to  champion 
technologies  and  concepts  designed  for  joint  operations,  according  to 
defense  officials  and  documents. 

The  creation  of  the  new  position  is  part  of  a  wider  effort  to  overhaul  the 
advanced  concept  technology  demonstration  program  —  the  Pentagon's 
marquee  project  for  rapidly  fielding  new  technologies  —  into  another  effort 
called  the  joint  capability  technology  demonstration  program. 

The  goal  is  to  expedite  deliveries  of  new  technologies  to  soldiers,  sailors, 
airmen  and  Marines  by  putting  in  place  new  funding  mechanisms  and 
organizations  to  make  sure  new,  proven  weapons  and  combat  technologies 
are  designed  for  use  by  more  than  one  service  and  not  orphaned  by 
individual  services  at  budget  time. 

Beginning  Oct.  1,  the  Pentagon  plans  to  have  in  place  the  new  acquisition 
executive  to  ensure  "cradle  to  grave"  funding  and  advocacy  for  promising 
technologies  that  do  not  have  clear  champions  in  the  Army,  Navy,  Air 
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Force  or  Marines.  This  new  post  would  be  equal  in  rank  to  the  service 
acquisition  executives,  according  to  Defense  Department  officials. 

To  facilitate  this  undertaking  the  Office  of  the  Secretary  of  Defense  has 
shifted  $40  million  in  its  fiscal  year  2006  budget  proposal  from  the  ACTD 
budget  line  to  initiate  JCTD  programs. 

"This  is  just  seed  money,"  said  Mark  Peterson,  head  of  program  resources 
and  integration  for  the  deputy  under  secretary  of  defense  for  advanced 
systems  and  concepts,  in  a  Feb.  22  interview.  "We  expect  in  next  year's 
budget  that  this  might  change." 

So  do  senior  Pentagon  officials.  In  a  late  December  budget  decision, 
Deputy  Defense  Secretary  Paul  Wolfowitz  directed  the  under  secretary  of 
defense  for  acquisition,  technology  and  logistics  and  the  chairman  of  the 
Joint  Chiefs  of  Staff  to  establish  an  improved  process  to  transition 
promising  ACTDs  to  acquisition  programs  and  bring  forward  a  new 
spending  proposal  this  summer  for  consideration  in  the  FY-07  budget. 

Pentagon  officials  say  the  joint  capability  technology  demonstration  effort 
is  designed  to  deliver  the  improved  transition  process  Wolfowitz  seeks.  It 
is  the  brainchild  of  Sue  Payton,  the  deputy  under  secretary  of  defense  for 
advanced  systems  and  concepts,  who  has  worked  for  the  last  1 8  months  to 
improve  the  ACTD  process  and  put  in  place  what  she  calls  a  new  business 
model  for  rapidly  fielding  new  technologies  desired  by  combatant 
commanders. 

Beginning  in  1994,  the  ACTD  program  established  an  alternate  route  to 
quickly  put  new  technologies  in  the  hands  of  warfighters.  The  program 
takes  new  but  relatively  mature  technology  and  offers  the  services  the 
opportunity  to  assess  prototypes  in  a  military  environment.  Targeted  to 
address  pressing  requirements,  ACTDs  typically  spend  three  to  four  years 
in  development,  after  which  a  handful  of  prototypes  are  delivered  to 
military  units.  They  spend  as  many  as  two  more  years  evaluating  the 
technology  for  operational  usefulness. 

This  four-  to  six-year  cycle  is  faster  than  the  traditional  acquisition  cycle, 
which  can  take  between  10  and  15  years  from  the  concept  stage  to 
fielding. 

In  some  cases,  technologies  developed  through  ACTDs  are  used  primarily 
by  a  single  service.  At  the  end  of  the  demonstration,  the  service  can  buy 
more  of  the  capability  or  walk  away  from  the  project.  Many  ACTDs, 
however,  are  designed  expressly  for  commanders  who  are  seeking  to 
improve  the  coordination  and  operations  of  service-specific  technologies 
that  weren't  designed  to  work  together.  In  some  cases,  the  objective  is  to 
acquire  a  technology  none  of  the  services  provides. 
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Once  an  ACTD  is  complete,  the  four-star  combatant  commanders  who 
sponsor  them  must  depend  on  one  of  the  services  to  acquire  the 
technology  and  fund  its  operational  use,  although  U.S.  Special  Operations 
Command  has  unique  acquisition  authority  and  is  exempt  from  this  rule. 
The  services,  however,  do  not  always  rank  ACTDs  desired  by  combatant 
commanders  high  in  their  procurement  portfolios. 

"Military  services  and  defense  agencies  have  been  reluctant  to  fund 
acquisition  of  ACTD-proven  technologies,  especially  those  focusing  on 
joint  requirements,  because  of  competing  priorities,"  the  Government 
Accountability  Office  said  in  a  December  2002  report. 

The  Pentagon's  FY-06  budget  request  includes  $40  million  to  kick  start  a 
number  of  proposals  aimed  at  correcting  key  difficulties  that  have  surfaced 
in  guiding  new  technologies  from  government  and  commercial 
laboratories  to  troops  and  into  the  Pentagon's  acquisition  and  operations 
accounts. 

These  funds  will  be  spread  across  four  new  program  elements  to  fund 
JCTDs  as  well  as  a  pilot  program  to  establish  a  new  defense  acquisition 
executive. 

This  new  position  would  share  rank  with  the  service  acquisition  executives 
and  be  the  primary  advocate  in  the  budget  process  for  joint  capabilities 
that  do  not  have  a  natural  place  in  any  of  the  service  accounts. 

Key  to  the  new  approach  is  a  change  in  how  projects  are  funded.  In  order 
to  remain  as  responsive  to  the  current  needs  of  combatant  commanders, 
the  Pentagon  keeps  ACTDs  out  of  its  planning,  programming  and  budget 
execution  cycle,  which  involves  a  two-year  delay  between  requesting  and 
receiving  funds. 

"So  every  time  an  ACTD  starts,  if  a  service  has  not  already  been  planning, 
you  have  to  break  [another]  program"  to  find  the  money  for  the  new 
project,  said  Peterson.  The  net  effect:  "We  create  an  instant  unfunded 
requirement,"  he  said. 

Under  the  JCTD  approach,  the  Office  of  the  Secretary  of  Defense  will 
provide  more  funds  at  the  beginning  of  a  project,  boosting  its  start-up 
contribution  from  30  percent  to  at  least  50  percent  in  order  to  reduce  the 
pressure  on  the  services  to  find  money  for  the  project  outside  of  the  budget 
cycle. 

The  JCTD  process  will  set  shorter  time  lines  for  demonstrating  new 
concepts  or  technologies. 

"We  would  like  to  make  that  quicker  by  at  least  a  year,"  said  Peterson. 
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The  JCTD  strategy  will  requires  a  final  demonstration  in  two  to  three 
years,  faster  than  the  three-year  to  four-year  goals  for  most  ACTDs.  In  the 
first  year,  JCTD  officials  will  be  required  to  deliver  a  preliminary 
capability. 

After  that,  they  must  be  50  percent  complete  by  the  end  of  the  second  year 
and  wrap  up  in  the  third  year.  Payton  also  wants  80  percent  of  JCTDs  to 
transition  at  least  half  of  their  products  into  a  permanent  place  in  the 
Pentagon's  budget. 

The  following  are  some  examples  of  FY06  ACTDs  and  JCTDs.  These 
ACTD/JCTDs  have  the  potential  to  support  COCOM  missions,  whether  or  not  they 
evolve  into  full-fledged  programs  of  record.  For  a  full  list  of  ACTDs  and  JCTDs,  refer  to 
Appendix  A  and  the  following  web  link. 

http://www.acq.osd.mil/actd/descript.htm 

•  Comprehensive  Maritime  Awareness  (CMA)  JCTD 

•  CHAMPION  (Counter  Intelligence-Human  Intelligence  Advanced 
Modernization  Program/Intelligence  Operations  Now)  JCTD 

•  Extended  Space  Sensors  Architecture  (ESSA) 

•  Joint  Modular  Intermodal  Distribution  System  (JMIDS)  JCTD 

•  Large  Data  JCTD 

•  Multi-service  Advanced  Sensors  to  Counter  Obscured  Targets  (MASCOT) 

•  Joint  Enable  Theater  Access  (JET A) 

•  Event  Management  Framework  (EMF) 

•  Node  Management  And  Deployable  Depot  (NOMADD) 

•  Small  UAV 

At  the  conclusion  of  the  ACTD  operational  demonstration,  there  are  three 
possible  outcomes. 

•  First,  recommend  acquisition  of  the  technology. 
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•  Second,  if  the  capability  or  system  does  not  demonstrate  military 
utility,  the  project  is  terminated  or  returned  to  the  technology  base. 

•  Third,  the  warfighter’s  need  is  fully  satisfied  by  the  fielded  prototype 
capability  that  remained  onboard  and  there  is  no  need  to  acquire 
additional  units. 


2.  ACTD/JCTD  Transition  Process 

Figure  3  below  outlines  possible  paths  which  the  ACTD  in  review  might  follow 
as  it  transitions  to  a  program  of  record. 
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Figure  3.  Alternatives  Following  Completion  of  ACTD  (From  Ref.  ACTD  2004). 

Transition  to  the  formal  Defense  acquisition  process  will  be  necessary  when 
development  or  production  is  required.  The  acquisition  category  will  depend  on  both  the 
number  and  cost  of  systems  required  to  meet  the  military  need.  The  next  step  is  to 
determine  at  what  point  does  the  ACTD  enters  the  acquisition  process.  If  significantly 
more  development  of  the  technology  is  required,  the  system  might  enter  into  the 
development  portion  of  the  Engineering  and  Manufacturing  Development  (EMD)  phase. 
On  the  other  hand,  if  the  capability  of  the  ACTD  is  sufficient  and  needed  promptly, 
entering  into  the  Low-Rate  Initial  Production  (LRIP)  portion  of  EMD  is  an  option. 
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There  are  three  generic  classes  of  ACTDs  that  present  significantly  different 
transition  challenges  (see  Figure  4): 

a.  Class  I  ACTD.  These  are  typically  informational  systems  with  special 
purpose  software  operating  on  commercial  workstations.  They  frequently  are  required  in 
small  quantities,  and  that  requirement  can  be  satisfied  without  further  development  or 
production  using  the  residual  ACTD  system  (residual  ACTD  systems  are  the  systems 
used  during  the  ACTD  that  are  left  behind  with  the  warfighter  to  meet  his  military  need) 
or  a  few  additional  systems  [ACTD  2004], 

b.  Class  II  ACTDs.  These  are  weapon  or  sensor  systems  similar  in  concept 
to  systems  that  are  acquired  through  the  formal  acquisition  process.  In  some  cases  a 
Class  II  ACTD  will  be  planned  ahead  of  time  to  transition  into  LRIP  following  ACTD, 
but  at  other  times  it  is  appropriate  to  plan  for  additional  development  following  the 
ACTD  [ACTD  2004], 

c.  Class  III  ACTDs.  These  ACTDs  are  best  described  as  “systems  of 
systems.”  This  means  that  an  individual  element  within  the  overall  system  of  a  Class  III 
ACTD  may  be  a  fielded  system,  a  system  already  in  acquisition,  or  a  system  emerging 
from  the  technology  base.  The  overall  ACTD  may  involve  multiple  Program  Executive 
Officers  (PEO),  and  perhaps  multiple  Military  Departments.  The  challenge  here  is  to 
integrate  and  coordinate  the  individual  transitions  to  achieve  the  capability  presented  in 
the  ACTD  [ACTD  2004], 
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Figure  4.  Classes  of  ACTDs  (From  Ref.  ACTD  2004). 

B.  ADVANCED  TECHNOLOGY  ORDNANCE  SURVEILLANCE  (ATOS) 

1.  Introduction 

From  major  distributions  sites,  such  as,  Naval  Surface  Warfare  Centereapons, 
Indian  Head  Division,  Maryland,  and  Crane  Army  Ammunition  Activity,  Crane,  Indiana, 
to  the  warfighter,  the  effective  management  practice  of  overseeing  munitions  has  long 
been  hindered  by  labor-intensive  inventory  methods  and  stockpile  inaccuracies.  The 
status  quo  (or  “as-is”)  transaction  process  involves  tedious  manual  data  entry  using 
inventory  sheets  to  track  and  monitor  the  flow  of  munitions.  The  loss  of  asset  visibility 
due  to  database  munitions  inaccuracies  adds  to  the  creation  of  a  host  of  problems  for  the 
acquisition  manager,  logistician,  storage  custodian,  and  most  importantly,  the  warfighter 
in  the  field.  These  problems  cause  the  overall  mission  readiness  to  be  degraded,  because 
needed  munitions  either  cannot  be  located,  or  when  located,  their  reliability  is  unknown 
because  the  current  surveillance  methods  fail  to  provide  the  critical  environmental 
information  required  to  determine  munitions’  serviceability  and  reliability.  Knowing 
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munitions  storage  conditions,  specifically  temperature,  relative  humidity,  and  gravity 
shock,  can  have  significant  impact  on  munitions’  safety  and  reliability.  By  taking 
advantage  of  the  latest  in  Automatic  Identification  Technologies  (AIT)  and  Micro- 
Electromechanical  Systems  (MEMS),  all  stakeholders  should  have  a  capability  that 
provides  near  real-time  environmental  information  and  automated  support  for  managing 
their  respective  munitions  stockpiles. 

Micro-Electrical-Mechanical  Systems  (MEMS)  are  promising  new  technologies 
that  facilitate  a  new  dimension  of  Focused  Logistics  support.  As  the  website 
http://www.memsnet.org/mems/what-is.html  describes  it, 

MEMS  is  the  integration  of  mechanical  elements,  sensors,  actuators,  and 
electronics  on  a  common  silicon  substrate  through  microfabrication 
technology.  While  the  electronics  are  fabricated  using  integrated  circuit 
(IC)  process  sequences  (e.g.,  CMOS,  Bipolar,  or  BICMOS  processes),  the 
micromechanical  components  are  fabricated  using  compatible 
"micromachining"  processes  that  selectively  etch  away  parts  of  the  silicon 
wafer  or  add  new  structural  layers  to  form  the  mechanical  and 
electromechanical  devices.  MEMS  promises  to  revolutionize  nearly  every 
product  category  by  bringing  together  silicon-based  microelectronics  with 
micromachining  technology,  making  possible  the  realization  of  complete 
systems-on-a-chip.  MEMS  is  an  enabling  technology  allowing  the 
development  of  smart  products,  augmenting  the  computational  ability  of 
microelectronics  with  the  perception  and  control  capabilities  of 
microsensors  and  microactuators  and  expanding  the  space  of  possible 
designs  and  applications. 

Microelectronic  integrated  circuits  can  be  thought  of  as  the  "brains"  of  a 
system  and  MEMS  augments  this  decision-making  capability  with  "eyes" 
and  "arms",  to  allow  microsystems  to  sense  and  control  the  environment. 

Sensors  gather  information  from  the  environment  through  measuring 
mechanical,  thermal,  biological,  chemical,  optical,  and  magnetic 
phenomena.  The  electronics  then  process  the  information  derived  from  the 
sensors  and  through  some  decision  making  capability  direct  the  actuators 
to  respond  by  moving,  positioning,  regulating,  pumping,  and  filtering, 
thereby  controlling  the  environment  for  some  desired  outcome  or  purpose. 
Because  MEMS  devices  are  manufactured  using  batch  fabrication 
techniques  similar  to  those  used  for  integrated  circuits,  unprecedented 
levels  of  functionality,  reliability,  and  sophistication  can  be  placed  on  a 
small  silicon  chip  at  a  relatively  low  cost. 

Through  the  use  of  real-time  sensor  data,  MEMS  provides  improved  situational 
awareness  and  asset  visibility  within  a  small  and  inexpensive  form.  MEMS  technology 
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uses  modem  electronics  fabrication  techniques  with  micro  machining  to  provide 
advanced  functionality  on  a  silicon  chip.  Through  proof-of-concept  projects,  U.S.  Army 
Logistics  Transformation  Agency  (LTA),  a  field  operating  agency  of  the  Deputy  Chief  of 
Staff,  G-4,  is  bringing  active  Radio  Frequency  Identification  (RFID)  devices  together 
with  MEMS  to  capture,  record,  and  communicate  temperature,  humidity,  shock,  light  and 
other  environmental  conditions.  When  combined  with  track  and  trace  capability  of  active 
RFID,  these  prototype  devices  can  provide  stand-off  asset  visibility,  self-reporting 
communications,  and  data  storage  functions  to  record,  alert  and  provide  immediate 
feedback  to  soldiers  and  logisticians  on  the  condition  of  assets.  Potential  applications  for 
MEMS  span  all  classes  of  supplies  and  logistics  processes  including  perishable 
subsistence,  diagnostics/prognostics  in  maintenance,  individual  protective  equipment, 
medical  supplies,  ammunition,  fuel,  inventory  and  shelf  life  management,  and  weapon 
system  condition  “health”  monitoring. 

The  LTA  is  examining  the  application  of  commercially  available  MEMS-based 
sensors  with  active  RFID  to  track  and  report  environmental  factors  that  affect  the 
viability  of  Class  VIII  medical  supplies.  At  present,  hundreds  of  thousands  of  dollars  are 
expended  annually  on  the  cost  of  labor  to  accomplish  manual  processes  related  to 
monthly  visual  monitoring  of  humidity  control  devices  on  Class  VIII  DEPMEDS  in  long 
term  storage  at  Sierra  Army  Depot  (SIAD).  Additionally,  millions  of  dollars  of  Medical 
Sets,  Kits  and  Outfits  (MESKOs)  materiel  had  to  be  destroyed  by  U.S.  Army  Medical 
Materiel  Center- Europe  (USAMMC-E)  in  2003  due  to  the  effects  of  unknown 
environmental  conditions  that  the  materiel  had  been  exposed  to  while  in  transit  or 
storage.  LTA  has  developed  a  high  level  RFID/MEMS  conceptual  design  analysis;  a 
Business  Process  Analysis  (BP A)  for  MEMS  application  to  Class  VIII  addressing  high- 
level  analyses  of  Deployable  Medical  Systems  (DEPMEDs),  Medical  Sets,  Kits  and 
Outfits,  and  Military  Vaccines;  and  has  tested  RFID  MEMS  technologies  in  a  laboratory 
setting. 
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2.  System  Description  and  Capabilities 

ATOS  is  an  RFID-based  automated  system  that  provides  a  capability  to  collect 
environmental  data  in  near  real-time  and  supports  munitions  management  tasks  on  stored 
munitions  pallets  [AFOTEC  2004], 

The  implementation  of  ATOS  data  rich  RFID  tags  is  not  meant  to  replace  any  of 
the  traditional  business  processes  of  Ordnance  Management  (OM).  Rather,  ATOS  tags 
are  meant  to  enhance  many  current  processes  and  add  additional  capabilities  to  OM. 

The  following  are  six  ATOS  oriented  munitions  management  tasks  which  form 
the  foundation  for  inventory  management  of  munitions: 

•  Munitions  Receipt 

•  Inventory  Maintenance 

•  Munitions  Movement 

•  Munitions  Issue 

•  Munitions  Transfer 

•  Munitions  Quality  Assurance  (QA) 

Figure  5  depicts  graphically  how  ATOS  automates  these  tasks 
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Figure  5.  ATOS  Automated  Munitions  Management  Functions  (From  Ref. 

AFOTEC  2004). 


The  ATOS  system  consists  of  six  major  components: 

1 .  RF  tag, 

2.  Handheld  Reader  (HHR), 

3.  Reader  Control  Unit  (RCU), 

4.  Pre-Processor  (PP), 

5.  Environmental  Database  (EDB),  and 

6.  An  interface  to  service  ammunition  Automated  Information 

System  (AIS). 
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Radio  Frequency  Extenders  (RFE)  are  used  to  enhance  RF  coverage  inside  larger 
enclosed  magazines  or  depots. 

The  RF  tag  is  a  small  enclosure  attached  to  a  munitions  pallet  using  an  RF  tag 
holder.  The  RF  tag  contains  temperature,  relative  humidity  (RH),  and  gravity-shock 
sensors.  The  temperature  and  RH  sensors  collect  environmental  data  according  to  a 
specified  period  of  time.  The  RF  tag  also  has  a  receiver,  transmitter,  and  non-volatile 
memory  to  receive,  transmit,  and  store  unique  asset  information  and  environmental  data. 
The  HHR  is  a  portable  wireless  barcode  scanning  device  with  the  capability  to  read  and 
write  asset  data  to  and  from  the  RF  tags  and  reads  linear  and  two-dimensional  barcodes. 
Using  a  keypad  and  touch  screen,  the  user  can  upload  and  download  asset  information  to 
and  from  the  RF  tags  using  a  function  called  roll  call,  which  queries  the  RF  tag  to  identify 
itself  and  provide  any  changes  to  asset  and  environmental  data.  Data  are  stored  in  the 
HHR  as  transaction  records  until  they  are  transferred  to  the  PP  for  analysis  and  archived. 
The  HHR  can  also  retrieve  stored  RF  tag  data  from  the  RCU  using  an  Ethernet  cable.  The 
HHR  uses  a  Windows  Pocket  Personal  Computer  operating  system,  which  is  a 
commercial  off-the-shelf  technology  (COTS)  software. 

The  RCU  is  a  fixed  RF  reader  that  collects  asset  and  environmental  data  from  the 

RF  tags.  The  RCU  is  powered  by  24  volts  direct  current  (YDC)  and  can  be  mounted 

inside  a  munitions  magazine.  Depending  on  the  size  of  the  magazine,  RFEs  are  connected 

in  series  with  the  RCU  to  achieve  optimal  RF  transmission  coverage.  The  RCU  obtains 

data  from  the  RF  tags  using  a  function  called  interrogation,  which  consists  of  two 

independent  reads  (short  and  long).  The  short  read  determines  the  number  of  RF  tags 

detected,  RF  tag  identification  (ID),  Department  of  Defense  Identification  Code 

(DODIC),  National  Stock  Number  (NSN),  consignee,  any  environmental  sensor  flags, 

and  a  low  battery  flag.  The  time  duration  for  a  short  read  depends  upon  the  number  of 

RFEs  connected  in  series  with  the  RCU,  the  number  of  RF  tags  detected  inside  the 

storage  facility,  and  the  type  of  material  (wooden  crates  and  aluminum  pallets)  on  which 

the  RF  tags  were  attached.  The  long  read  downloads  the  remaining  asset  information  and 

environmental  data.  The  duration  of  a  long-read  can  take  hours  to  days  depending  on  the 

number  of  RF  tags  being  interrogated.  The  RCU  serves  as  a  long-term  data  storage  unit 

for  receiving  and  storing  interrogated  RF  tag  data.  The  RCU  stores  these  data  until  the  PP 
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commands  it  to  transfer  the  data  via  a  wireless  local  area  network  (WLAN),  local  area 
network  (LAN),  serial  cable  connection  with  the  HHR.  The  RCU  has  no  direct  user 
interface,  i.e.,  no  keyboard  or  display. 

The  PP  is  an  interactive  command  and  control  system  designed  to  retrieve  RF  tag 
data  from  the  RCU  and  HHR.  The  PP  is  typically  located  in  the  central  work  area. 
Munitions  information  is  formatted  and  passed  from  the  PP  to  the  service  ammunition 
AIS,  such  as  the  Retail  Ordnance  Logistics  Management  System  for  the  U.S.  Navy  local 
and  theater  inventory  management  of  munitions,  and  the  EDB.  Munitions  experts  and 
analysts  can  use  the  Environmental  Database  to  evaluate  munitions  performance 
fluctuations  due  to  environmental  changes. 

Figure  6  shows  the  connectivity  for  the  ATOS  system  components. 


Figure  6.  ATOS  System  Architecture  (From  Ref.  AFOTEC  2004). 
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III.  ATOS  BUSINESS  CASE  ANALYSIS 


A.  WHAT  IS  A  BUSINESS  CASE  ANALYSIS  (BCA)? 

A  Business  Case  Analysis  examines  and  compares  the  benefits,  costs,  and 
uncertainties  of  each  alternative  to  determine  the  most  cost  effective  means  of  meeting 
the  objective.  It  is  a  systematic  approach  to  the  problem  of  resource  allocation, 
comparing  two  or  more  alternatives  in  terms  of  cost  and  benefits. 

The  standard  steps  in  a  BCA  are  below: 

•  Objectives  of  the  action  being  considered 

•  Specification  of  assumptions/constraints 

•  Identification  of  alternatives 

•  Listing  of  benefits  for  all  feasible  alternatives 

•  Cost  estimates  for  each  feasible  alternative 

•  A  ranking  of  alternatives  in  terms  of  costs  and  benefits 

•  Risk/uncertainty  analysis 

•  Conclusions/recommendations 

Decisions  about  mission  and  business  planning  are  important  because  they 
become  the  basis  for  deciding  whether  an  acquisition  will  be  funded.  Budget  constraints 
are  the  main  reasons  that  force  organizations  to  justify  their  spending,  because  if  there 
were  no  budget  constraints,  then  we  could  buy  anything  and  everything,  and  not  have  to 
engage  in  making  choices.  A  BCA  is  a  process  for  preparing  a  structured  proposal  that 
establishes  sound  business  decisions  for  proceeding  with  an  investment/project  by 
providing  decision  makers  with  the  insight  into  how  the  investment/project  supports  the 
business  needs  and  strategic  goals.  The  BCA  structures  the  assessment  by  providing 
necessary  information  concerning  the  scope,  alternatives  considered,  estimated  costs  and 
Return  on  Investment  (ROI),  and  risks  necessary  for  decision  makers  to  make  an 
informed  funding  decision  for  the  investment/project.  Therefore,  budget  constraints 
cause  an  increase  in  the  usage  of  Business  Case  Analysis  (BCA). 
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Each  BCA  will  be  different  depending  on  its  application.  However,  a  BCA 
structure  should  include  the  following  as  a  minimum  [ACC  2004], 

•  Introduction.  It  presents  the  objectives  addressed  by  the  subject  of  the 
case,  and  all  the  options,  including  the  status  quo,  considered  to 
achieve  the  objective. 

•  Assumptions  and  Methods.  Outlines  the  rules  for  deciding  what 
belongs  in  the  case,  and  what  does  not,  along  with  the  critical 
assumptions. 

•  Business  Impacts.  The  main  business  case  results. 

•  Sensitivity  and  Risk  Analysis.  Shows  how  results  depend  on  the 
important  assumptions  (“what  if’),  as  well  as  the  likelihood  for  other 
results  to  surface. 

•  Conclusions  and  Recommendations.  Recommends  specific  actions 
based  on  business  objectives  and  the  results  of  the  analysis. 


1.  The  BCA  Process 

Figure  7  displays  the  BCA  process  consisting  of  four  steps. 

•  Definition  is  the  first  step  in  the  BCA  process  and  sets  the  scope  of  the 
problem.  During  this  step,  the  assumptions  and  the  constraints  are 
formulated  which  will  guide  the  analysts  of  the  BCA  Team  throughout 
the  process.  Also  in  this  step,  alternatives  to  be  considered  are 
identified,  as  well  as  the  measures. 

•  Data  Collection  is  the  second  step  in  the  BCA  process  and  is  where  the 
source  and  types  of  data  to  be  collected  are  identified.  The  collection 
of  data  may  be  difficult  because  the  data  may  be  obscured  in  databases 
in  remote  locations  or  buried  in  budget  documents. 

•  Evaluation  Analysis  is  the  third  step  in  the  BCA  process  and  is  where 
the  “number  crunching”  is  done.  In  this  step,  the  data  that  was 
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collected  in  the  second  step  is  used  to  build  a  case  for  each  alternative, 
using  both  qualitative  and  quantitative  data.  Each  alternative  is 
compared  against  each  other,  in  an  effort  to  identify  a  best  alternative. 
It  is  important  that  analysts  should  not  only  seek  to  determine  which 
alternative  has  the  lowest  cost,  but  which  alternatives  provide  the 
optimal  combination  of  price  and  performance. 

•  Results  Presentation  is  the  fourth  step  in  the  BCA  process.  This  is  a 
critical  step  because  if  the  BCA  Team  is  unable  to  communicate 
effectively  the  results  to  the  decision  makers,  the  analysis  is  worthless. 
Conclusions  are  to  be  organized  around  the  objectives  stated  up  front 
in  the  case.  The  recommendation  of  the  BCA  will  consist  of 
recommending  to  stay  with  the  status  quo  or  to  adopt  the  alternative(s) 
being  considered. 


Definition 


Collection 


Analysis 


Presentation 


Figure  7.  The  Business  Case  Analysis  Process  (From  Ref.  ACC  2004). 
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B.  WHAT  IS  A  WORK  BREAKDOWN  STRUCTURE  (WBS)? 

A  Work  Breakdown  Structure  (WBS)  is  a  hierarchical  approach  to  plan  and 
integrate  the  various  parts  of  a  project.  The  Department  of  Defense  Handbook,  MIL- 
HDBK-881,  defines  a  WBS  as  follows: 

•  A  product-oriented  family  tree  composed  of  hardware,  software, 
services,  data,  and  facilities. 

•  The  family  tree  results  from  systems  engineering  efforts  during  the 
acquisition  of  a  defense  materiel  item. 

The  following  are  a  few  benefits  of  how  a  WBS  may  assist  a  Program  Manager 
(PM)  during  the  life  cycle  of  a  program  [MIL-HDBK-881], 

•  Separates  a  defense  materiel  item  into  its  component  parts,  making  the 
relationships  of  the  parts  clear  and  the  relationship  of  the  tasks  to  be 
completed-to  each  other  and  to  the  end  product-clear. 

•  Affects  significantly  planning  and  the  assignment  of  management  and 
technical  responsibilities. 

•  Assists  in  tracking  the  status  of  engineering  efforts,  resource 
allocations,  cost  estimates,  expenditures,  and  cost  and  technical 
performance. 

•  Helps  ensure  that  contractors  are  not  unnecessarily  constrained  in 
meeting  item  requirements. 

By  displaying  and  defining  the  efforts  to  be  accomplished,  the  WBS  becomes  a 
management  blueprint  for  the  product  and  reduces  the  likelihood  of  something  falling 
through  the  cracks. 


1.  Work  Breakdown  Structure  for  ATOS 

To  be  able  to  provide  a  realistic  BCA  of  the  implementation  of  an  ATOS 
infrastructure  at  a  Navy  Munitions  Management  location,  the  advice  of  Subject  Matter 
Experts  (SMEs)  from  Naval  Surface  Warfare  Center  (NSWC),  Indian  Head  Division,  was 
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seek  to  validate  the  additional  sustained  cost  in  fielding  ATOS.  The  top  level  WBS  is 
composed  of  the  following  components: 

•  Investment 

•  Operation  and  Support  (O&S) 

•  Environmental 

The  ATOS  infrastructure  at  a  Munitions  Management  facility  will  consume  the 
biggest  portion  of  the  investment  funding  due  to  the  amount  of  equipment/software, 
installation  cost,  and  personnel  training  needed  for  the  newly  fielded  system.  Of  course, 
the  number  of  munitions  magazines  and  the  number  of  munitions  in  a  facility  will  dictate 
the  true  implementation  cost. 

Operation  and  Support  consists  of  the  costs  needed  to  sustain  the  ATOS 
infrastructure.  The  recurring  costs  are  the  cost  incurred  to  continue  the  validation  of 
models  and  to  maintain  the  readiness  of  the  system,  i.e.,  to  replace  equipment/software 
due  to  damage,  normal  wear  and  tear,  and  system  upgrades  throughout  the  life  cycle  of 
the  system. 

Critical  environmental  information,  e.g.,  munitions  storage  conditions,  is  needed 
to  determine  munitions’  safety,  reliability,  and  performance.  The  status  of  the  munitions 
is  critical  for  the  following  three  reasons: 

1 .  Safety.  Munitions  accidentally  exploding  in  munitions  magazines 
or  afloat  without  warning  pose  great  danger  to  personnel  and  property. 

2.  Reliability.  Warfighter  should  have  reliable  munitions  they 
depend  on  a  daily  basis.  When  munitions  is  intentionally  launched  or  fired  (pulled  the 
trigger),  the  munitions  should  leave  the  canister  of  a  Vertical  Launch  System  (VLS)  or 
the  muzzle  of  a  gun  without  delay.  The  life  of  the  warfighter  may  be  on  jeopardy. 

3.  Performance.  When  the  munitions  have  been  launched,  they  are 
expected  to  perform  to  their  specifications,  i.e.,  fly  at  their  intended  speed  and  correct 
altitude,  for  mission  success  and  accomplishment. 
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The  collection  of  environmental  data,  such  as  time-phased  histories  of 
temperature,  humidity,  and  shock  for  the  munitions  under  surveillance,  is  for  munitions 
incident  prevention.  Knowing  the  reliability  and  the  shelf  life  of  munitions  are  key  in 
munitions  incident  prevention.  Being  conscious  of  the  storage/environmental  factors 
munitions  are  experiencing  or  have  experienced  in  the  field,  can  lead  to  the  prevention  of 
munitions  magazines  from  inadvertently  exploding  due  to  munitions  instability  or  shelf 
life  expiration,  thereby,  saving  in  the  clean-up  effort,  collateral  damage  to  property,  or 
more  importantly,  the  safety  of  personnel. 

We  spoke  to  Subject  Matter  Experts  whose  recollection  is  that  incidents  have 
occurred  only  ashore,  and  not  afloat.  This  is  because  ashore  munitions  management 
facilities  intentionally  accelerate  (“cook-off’)  the  shelf  life  of  munitions.  This  serves  as  a 
munitions  plan  to  advise  afloat  units  about  the  serviceability  and  reliability  of  their 
munitions  onboard. 

Subject  Matter  Experts  also  say  that  two  incidents,  one  in  1970  and  one  in  1994, 
are  the  only  incidents  that  have  occurred  in  the  last  three  decades,  and  that  in  these  two 
incidents,  gun  propellant  was  the  common  denominator.  That  is  about  one  incident  every 
twelve  years  or  0.1  incidents  per  year. 

ATOS  will  play  a  key  role  in  Quality  Evaluation  (QE),  also  known  as 
Surveillance.  The  mission  of  QE  is  to  determine  the  safety,  reliability,  and  performance 
of  munitions.  When  QE  is  accomplished,  munitions  are  dissected  to  determine  the  status 
of  similar  munitions.  Obviously,  dissected  munitions  are  lost  munitions  to  the  inventory. 
According  to  Subject  Matter  Expert,  Mr.  Roger  Swanson,  NOSSA  (N8),  Director 
Weapons  Assessment,  it  is  impossible  to  conduct  QE  on  all  DoD’s  munitions  stockpiles 
because  of  funding  constraints  and  time.  For  this  reason,  the  current  program  only  has 
QE  personnel  conduct  QE  on  selected  munitions  that  have  the  greatest  susceptibility  to 
the  environment.  For  example,  QE  on  a  missile’s  rocket  motor  is  accomplished  once 
every  three  years  depending  on  the  rocket’s  propellant  composition.  Under  the  current 
practice,  munitions  are  added  to  the  QE  list  only  when  a  mishap  occurs.  This  procedure 
has  the  disadvantage  that  we  react  after  the  fact,  i.e.,  after  a  mishap  has  occurred.  ATOS, 
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with  its  potential  to  collect  the  necessary  environmental  munitions  data  fixes  this 
disadvantage  because  QE  will  be  done  on  all  munitions  vice  just  the  selected  few. 

The  RFID  tags  attached  to  munitions  pallets  will  have  the  capability  to  collect 
data  on  temperature,  humidity,  and  shock  of  all  munitions.  These  data,  provided  to  QE 
personnel,  can  be  analyzed  with  the  right  models  to  predict  with  a  high  degree  of 
accuracy  the  safety,  reliability,  and  the  performance  of  the  munitions  the  warfighters  are 
employing  in  theater  on  a  daily  basis.  The  funding  for  model  development  and 
implementation  will  be  a  recurring  cost  for  fielding  ATOS. 

C.  “AS-IS”  COST  (A  WORLD  WITHOUT  ATOS) 

1.  Ordnance  Management  Process 

The  current  Ordnance  Management  process  is  labor  intensive.  It  entails  the 
manual  data  entry  using  inventory  sheets  to  track  and  monitor  the  Department  of  Defense 
munitions  stockpiles.  In  this  process,  personnel  physically  have  to  conduct  every 
munitions  management  task,  i.e.,  physically  count  all  munitions  in  a  munitions  magazine 
when  conducting  an  inventory.  Many  man-hours  are  spent  doing  any  one  task  which  can 
be  translated  to  hundred  of  thousands  of  dollars  per  year.  Additionally,  the  manual  effort 
is  subject  to  errors,  which  then  yield  an  inaccurate  database. 

The  following  six  munitions  management  tasks  that  form  the  foundation  for  the 
inventory  management  of  munitions  used  in  the  Military  Utility  Assessment  by  AFOTEC 
demonstrates  how  labor  intensive  the  current  process  can  be  [AFOTEC  2004], 

1.  Munitions  Receipt.  When  munitions  arrive  at  a  Munitions 
Management  facility,  personnel  need  to  be  available  for  receiving  the  munitions,  move 
the  munitions  to  the  storage  location,  and  add  the  munitions  to  the  current  inventory. 

2.  Inventory  Maintenance.  Personnel  physically  need  to  count  all 
munitions  in  a  munitions  magazine  to  maintain  inventory  information  on  all  magazines. 
The  inaccuracy  of  this  inventory  information  is  subject  to  human  error. 

3.  Munitions  Movement.  When  munitions  are  moved  from  one 
magazine  to  another,  personnel  need  to  do  the  manual  data  entry  that  reflects  the  change 
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to  the  magazine  inventory.  Again,  the  inaccuracy  of  this  inventory  information  is  subject 
to  human  error. 

4.  Munitions  Issue.  When  munitions  are  issued  to  the  warfighter, 
personnel  need  to  update  the  magazine  inventory  and  the  munitions  database  to  reflect 
the  current  inventory.  Again,  the  inaccuracy  of  this  inventory  information  is  subject  to 
human  error. 

5.  Munitions  Transfer.  When  large  amounts  of  munitions  are  shipped 
to  another  Munitions  Management  facility  or  to  the  warfighter  in  theater,  personnel  need 
to  manually  conduct  the  data  entry  to  reflect  the  munitions  transfer  at  both  the  munitions 
database  and  the  magazine  inventories.  Again,  the  inaccuracy  of  this  inventory 
information  is  subject  to  human  error. 

6.  Munitions  Quality  Evaluation/Surveillance.  When  QE  personnel 
remove  munitions  for  inspection,  the  results  of  the  inspection  or  condition  of  the 
munitions  need  to  be  recorded  in  the  munitions  logbooks.  Again,  the  inaccuracy  of  this 
inventory  information  is  subject  to  human  error. 

2.  Ordnance  Management  Cost 

The  current  Ordnance  Management  process  used  to  manage  DoD’s  large 
munitions  stockpiles  does  not  track  the  status  of  all  munitions  in  the  inventory,  but  yet  is 
costing  DoD  millions  of  dollars  a  year.  The  following  describe  why  the  current 
management  process  of  munitions  has  caught  the  attention  of  DoD. 

Demilitarization  of  all  munitions  is  performed  and  paid  by  the  U.S.  Army.  The 
Department  of  the  Navy  alone  in  FYOO  generated  over  16,000  tons  of  ordnance  that 
needed  demilitarization  and  disposal  at  an  average  cost  of  $892  per  ton  of  material  for  a 
total  cost  of  over  $14M.  The  Army’s  disposal  budget  would  be  greatly  reduced  if  the 
services  found  a  way  to  expend  a  greater  portion  of  its  munitions  before  they  become 
obsolete  and  require  high  cost  to  dispose  [Herb]. 

Corrosion  is  another  challenge  for  DoD.  It  affects  mission  readiness  and  adds 
additional  cost  in  shipping  replacement  munitions.  Corrosion  is  defined  as  a  chemical 
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reaction  between  a  material,  usually  a  metal,  and  its  environment  that  produces  a 
deterioration  of  the  material  and  its  properties.  Changes  in  the  environment,  i.e.,  changes 
in  temperature  and  humidity,  cause  munitions  to  corrode  thereby  costing  DoD  millions  of 
dollars  in  corrosion  maintenance.  While  corrosion  is  a  problem  for  all  services,  not  just 
the  USAF,  we  can  gain  an  appreciation  of  the  magnitude  of  the  problem  reported  in  the 
final  report  submitted  February  16,  2005,  by  C  Technology,  Inc,  to  the  USAF  on  the  cost 
of  corrosion.  This  report  states  that  the  USAF  in  FY04  spent  $43M  in  munitions 
corrosion  maintenance. 

Munitions  handling  can  be  a  dangerous  evolution  because  munitions  can  be 
accidentally  dropped  and  depending  on  the  condition  of  the  munitions,  they  can  either 
explode  or  they  do  not  explode.  If  munitions  are  dropped  and  they  do  not  explode,  the 
current  procedure  has  these  munitions  shipped  to  a  location  where  they  can  be 
investigated  for  damages.  This  would  be  great  for  single  munitions,  e.g.,  a  missile.  If  a 
pallet  of  munitions  is  dropped  instead,  the  entire  pallet  is  being  shipped  to  be  checked  for 
damages  because  personnel  cannot  determine  the  condition  of  the  munitions  in  the  pallet. 
Not  all  munitions  may  be  damaged,  but  there  is  currently  no  way  of  determining  the 
condition  of  all  munitions  in  the  pallet.  The  inability  to  determine  the  condition  of  the 
munitions  affects  mission  readiness  and  adds  additional  cost  in  shipping  replacement 
munitions. 

The  purpose  of  the  Quality  Evaluation  program  is  for  DoD  to  continuously 

monitor  and  track  the  safety,  reliability,  and  performance  of  only  selected  munitions  to 

ensure  these  munitions  stockpiles  are  at  their  highest  state  of  readiness.  As  previously 

mentioned,  it  is  impossible  to  do  QE  on  all  munitions  stockpiles.  Munitions  are  added  to 

the  QE  list  only  after  a  fleet  or  ashore  incident  has  occurred.  According  to  Mr.  Roger 

Swanson,  in  FY08  and  onwards  he  will  receive  a  budget  of  $3M  to  support  QE  on  only 

surface  ordnance.  This  $3M  is  used  for  destructive  testing/inspection  and  to  conduct 

analysis  to  determine  the  service  life  and  to  revise  the  maintenance  schedule,  if 

necessary,  for  the  munitions.  Additionally,  he  requires  an  additional  $1.5M  a  year  for 

test  equipment  used  in  testing  munitions  stockpiles  for  bit  checks.  Bit  checks  only 

indicate  whether  the  munitions  are  good  or  bad,  i.e.,  up  or  down.  If  it  indicates  down, 

additional  testing  and  maintenance  is  required  to  determine  the  failure.  Testing 
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equipment  does  not  indicate  how  the  munitions  will  perform  once  launched.  The 
destructive  testing/inspection  and  analysis  done  produce  the  ultimate  results  desired  to 
find  out  how  munitions  will  perform  when  launched. 

Destructive  testing/inspections  on  munitions,  e.g.,  a  missile’s  rocket  motor,  are 
done  every  three  years  depending  on  the  rocket’s  propellant  composition.  According  to 
Mr.  Swanson,  a  complete  QE  costs  $0.5M  per  rocket.  This  does  not  include  the  buying 
of  the  replacement  rocket  required  to  return  the  missile  to  a  state  of  mission  readiness. 
Again,  depending  on  the  rocket’s  propellant  composition,  a  rocket  will  cost  the  service 
between  $50,000  and  $250,000. 

Although  munitions  mishaps  hardly  ever  occur  afloat  or  ashore  (0.1  incidents  per 
year),  the  cost  they  can  incur  cannot  be  overlooked.  In  the  1994  munitions  incident,  the 
cost  to  DoD  was  over  $1M  for  the  destruction  of  the  munitions  magazine,  $590,000  for 
the  lost  of  munitions,  and  $400,000  for  the  clean-up  efforts.  This  does  not  include  the 
investigation  cost  to  DoD  to  determine  the  cause  of  the  explosion. 


D.  “TO-BE”  COST  (A  WORLD  WITH  ATOS) 

1.  Ordnance  Management  Process 

The  implementation  of  ATOS,  as  previously  mentioned,  is  not  meant  to  replace 
any  of  the  current  traditional  business  processes  of  Ordnance  Management.  Rather, 
ATOS  is  meant  to  enhance  the  current  Inventory  Management  process  and  add  additional 
capabilities  to  Ordnance  Management,  e.g.,  the  system  will  be  capable  of  automatically 
monitoring  and  reporting  user  defined  environmental  conditions  experienced  by  the 
munitions  in  near  real-time.  Additionally,  by  implementing  ATOS  the  number  of  labor 
intensive  man-hours  expended  in  accomplishing  the  current  Inventory  Management 
process  discussed  above,  can  be  greatly  reduced. 

The  following  is  a  description  of  how  the  six  munitions  management  tasks  of  the 
Inventory  Management  process  used  in  the  MUA  by  AFOTEC  can  be  improved  when 
using  ATOS  so  that  the  reduced  workload  can  allow  for  other  productive  efforts  to  be 
accomplished  [AFOTEC  2004], 


38 


1.  Munitions  Receipt.  When  munitions  arrive  at  a  depot,  munitions 
or  logistics  personnel  attach  RF  tags  to  munitions  pallets  and  populate  RF  tags  with  asset 
information  for  each  munitions  pallet  using  the  HHR.  Next,  tagged  munitions  pallets  are 
receipted  and  the  asset  information  is  stored  on  the  HHR  as  a  transaction  record.  Tagged 
munitions  pallets  are  moved  to  a  storage  location  where  the  RCU  retrieves  the  asset 
information  and  the  latest  environmental  data  from  the  munitions  pallets.  The  RCU 
updates  and  stores  the  RF  tag  data  until  the  PP  commands  it  to  transfer  the  data  via 
WLAN,  LAN,  or  the  HHR  serial  port.  The  PP  reconciles  the  transaction  records  from  the 
HHR  and  RCU  data,  updates  the  inventory  list,  and  graphically  displays  the  data  on  the 
computer  screen. 

2.  Inventory  Maintenance.  The  RCU  maintains  the  munitions 
inventory  through  periodic  interrogations  of  the  RF  tags.  If  the  RCU  encounters  a  new  or 
missing  RF  tag,  it  sends  a  flag  to  the  PP.  When  conducting  inventory  tasks  using  an 
HHR,  the  ATOS  operator  first  downloads  the  inventory  list  from  the  PP  to  the  HHR.  The 
operator  then  takes  the  HHR  to  the  magazine.  The  HHR  queries  the  RF  tags  and 
reconciles  the  inventory  list  with  the  tagged  munitions  pallets  inside  the  magazine.  Any 
new  or  missing  RF  tags  are  flagged  by  the  HHR  and  associated  data  are  later  transferred 
to  the  PP.  The  operator  takes  appropriate  actions  to  resolve  any  flags  that  were  sent  to  the 
PP  from  the  HHR  or  RCU.  Throughout  this  process,  the  RF  tags  continually  collect  and 
store  environmental  data. 

3.  Munitions  Movement.  When  tagged  munitions  pallets  are  moved 
from  one  location  to  another  within  the  same  depot,  the  operator  uses  the  HHR  to  update 
the  RF  tag  location  information.  On  the  next  interrogation,  the  RCU  automatically 
updates  location  data  on  the  PP  inventory  list. 

4.  Munitions  Issue.  The  operator  issues  one  or  more  individual 
munitions  items  from  tagged  munitions  pallets  to  a  local  field  unit  and  uses  the  HHR  to 
update  the  munitions  count  on  the  RF  tag.  The  RCU  captures  the  munitions  count  change 
and  updates  the  PP  inventory  list. 

5.  Munitions  Transfer.  The  operator  ships  a  tagged  munitions  pallet 
to  a  location  outside  of  the  depot,  using  the  HHR  to  document  the  transfer.  The  operator 
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uses  the  HHR  to  download  the  latest  asset  information,  environmental  data,  and  any 
alarm  flags.  The  HHR  is  docked  to  the  PP  and  data  are  transferred  to  the  PP.  The  RF  tag 
ID  number  is  removed  from  the  inventory  list  and  the  data  are  archived.  The  PP 
automatically  updates  the  inventory  records  of  the  losing  depot  when  the  HHR  is  docked 
to  the  PP.  Munitions  pallets  are  not  tracked  while  in  transit  between  depots,  but  the  RF 
tags  will  continue  to  collect  environmental  data,  which  is  transferred  to  the  PP  at  the  final 
destination. 

6.  Munitions  Quality  Evaluation/Surveillance.  The  operator  removes 
one  or  more  individual  munitions  items  from  tagged  munitions  pallets  for 
inspection/maintenance.  QE  personnel  use  the  HHR  to  update  the  pallet  condition  code 
and  history  to  reflect  the  status  of  the  individual  munitions  items  and  what  QE  actions 
were  taken  upon  its  return  to  the  inventory.  The  RCU  captures  the  updated  information 
and  transfers  it  to  the  PP.  The  PP  then  reconciles  the  RCU  and  HHR  data  and  updates  the 
inventory  list. 


2.  Ordnance  Management  Process  Cost 

There  are  many  benefits  in  implementing  an  ATOS  infrastructure.  One  of  the 
main  objectives  is  to  reduce  the  cost  of  the  current  Inventory  Management  process.  The 
initial  fielding  of  ATOS  will  be  the  additional  cost  incurred  in  the  first  year.  From  the 
second  year  onwards,  DoD  will  benefit  from  the  dividends  that  ATOS  provides  in  the 
inventory  of  munitions.  For  the  dividends  in  the  environmental,  munitions  environmental 
data  needs  to  be  collected  for  at  least  a  ten-year  time  frame.  The  following  describe  how 
ATOS  changes  the  current  management  of  munitions. 

Manpower  costs  are  expected  to  be  reduced  because  personnel  no  longer  have  to 
do  the  wall  to  wall  inventories  that  can  take  many  man-hours.  ATOS  provides  magazine 
inventories  near  real-time.  Additionally,  many  man-hours  are  saved  in  the  receipt  of 
munitions  because  documents,  such  as  DD 1348-1  forms,  will  be  obtained  from  the 
accountable  officer  and  uploaded  directly  into  the  handheld  readers. 

Demilitarization  is  another  area  in  which  DoD  can  save  millions  of  dollars  a  year. 
There  is  currently  no  implemented  method  that  identifies  the  condition  of  all  munitions  in 
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inventory.  Quality  Evaluation  done  in  selected  munitions  is  the  only  method  that  exists 
that  identifies  the  serviceability  and  reliability  of  munitions.  If  munitions  of  a  specific 
batch  are  identified  as  “bad”  munitions,  the  entire  batch  manufactured  on  the  same  date 
are  removed  from  inventory  and  taken  to  be  demilitarized.  This  is  also  true  for  munitions 
that  are  accidentally  dropped.  If  the  dropped  munitions  tested  “bad”,  the  entire  pallet  of 
dropped  munitions  is  removed  from  inventory  without  further  testing. 

The  ability  to  gather  environmental  data  munitions  are  experiencing  or  have 
experienced  in  the  magazines,  in  transit,  or  in  the  field,  can  reduce  the  millions  of  dollars 
DoD  is  currently  spending  in  corrosion  maintenance.  The  environmental  data  collected 
can  be  used  to  change  the  environmental  conditions  under  which  the  munitions  are  being 
stored.  Additionally,  this  can  assist  personnel  in  revising  the  maintenance  schedule  of 
munitions  stored  under  different  conditions,  i.e.,  in  the  field  vice  being  stored  in  a 
munitions  magazine. 

The  collection  of  munitions  temperature,  humidity,  and  shock/vibrations  will  be 
used  as  input  data  for  models  to  determine  the  munitions  service  life  and  to  revise 
maintenance  schedule  of  all  munitions,  instead  of  just  the  current  munitions  on  the  QE 
list.  This  ATOS  initiative  will  significantly  enhance  the  QE  process. 

According  to  Mr.  Swanson,  ATOS  has  the  potential  to  reduce  QE  expenditure  by 
as  much  as  83%  as  there  will  be  no  need  to  conduct  destructive  testing/inspection  of 
munitions  as  the  QE  program  currently  calls  for.  This  does  not  mean  that  destructive 
testing/inspection  will  be  terminated.  This  type  of  testing  will  still  be  required  but  over  a 
longer  period  of  time,  i.e.,  ten  years  vice  three  years,  to  validate  and  improve  the  working 
models. 

The  cost  of  developing  and  validating  models  depends  on  the  models’  complexity, 
and  the  cost  is  comprised  almost  exclusively  of  labor  costs  which  come  with  a  decent 
price  tag.  I  anticipate  that  the  type  of  model  that  will  be  required  to  assist  in  QE  of 
munitions  will  cost  about  $1.5M  annually. 
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E.  METHODOLOGY  FOR  ASSESSING  CHANGES  DUE  TO  ATOS 

IMPLEMENTATION 

For  each  Element  in  the  ATOS  Work  Breakdown  Structure,  a  judgement  is  made 
on  what  percentage  reduction  in  the  As-Is  costs  is  caused  by  the  implementation  of 
ATOS.  These  percentage  reductions  will  be  SME-based  for  this  thesis  and  pilot-project- 
data-based  in  the  future. 

The  reason  these  percentage  reductions  are  SME-based  is  because  there  has  not 
been  an  ATOS  pilot  program  implemented  long  enough  to  collect  sufficient  data  to 
accurately  annotate  the  realistic  reductions.  The  ATOS  pilot  programs  implemented  thus 
far  have  been  programs  implemented  at  a  lower  scale  to  collect  data  to  conduct,  e.g.,  a 
Military  Utility  Assessment  (MU A).  These  programs  have  been  tailored  to  accomplish 
specific  objectives  or  answer  questions  posed  by  DoD  decision  makers. 

The  Subject  Matter  Experts  consulted  in  the  process  of  thesis,  have  been 
personnel  who  have  been  actively  involved  in  one  way  or  another  with  ATOS  and  are 
currently  Program  Mangers  at  NSWC,  Indian  Head,  or  Ordnance  Managers/Supervisors 
at  Seal  Beach  Weapons  Station.  Ordnance  Managers  being  both  extremely  familiar  with 
the  ordnance  inventory  management  processes  at  their  munitions  sites  and  being  actively 
engaged  in  the  ATOS  initiative  are  the  most  qualified  personnel  to  perceive  what  steps  in 
the  ordnance  process  can  be  automated  with  ATOS  implementation  and  what  percentage 
reduction  is  realistic  in  the  process.  Of  course,  these  are  estimates  and  vary  from 
munitions  site  to  munitions  site  depending  on  the  amount  of  munitions  stockpiles  being 
accountable  for. 

In  the  inventory  management  process,  these  percentage  reduction  estimates  are 
most  confident  because  most  work  done  thus  far  in  ATOS  has  been  in  this  area  of 
interest.  The  percentage  reduction  estimates  in  the  environmental  area  of  interest,  are  not 
with  a  high  degree  of  confidence.  This  is  because  pilot  programs  have  not  been 
implemented  to  collect  munitions  environmental  data  to  support  these  estimates.  All 
SMEs  concur  that  it  can  take  10  to  12  years  of  munitions  environmental  data  collection 
before  a  rational  data-supported  estimate  can  be  achieved. 
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The  percentage  reduction  estimates  provided  by  the  SMEs  as  stated  above,  are  our 
initial  estimates  that  need  to  be  validated  by  the  results  from  pilot  projects.  This  will 
occur  as  SMEs  over  time  have  collected  sufficient  data  to  analyze  and  recommend  more 
precise  estimates.  At  that  point,  the  savings  ATOS  provides  will  be  embraced  by  the 
services  that  are  not  now  providing  their  full  support. 

Table  2  below  displays  the  percentage  reduction  estimates  that  are  used  in  this 
analysis. 


F.  COMPARISON  OF  “AS-IS”  TO  “TO-BE” 

Two  Return  on  Investment  analysis  are  presented. 

•  The  first  ROI  is  on  the  impact  of  an  investment  in  an  ATOS  infrastructure 
on  the  Inventory  Management  process  and  the  successful  management  of 
DoD’s  munitions  stockpiles.  We  have  access  to  some  data  for  this 
analysis,  and  the  benefits  from  this  investment  are  available  to  the  analysts 
relatively  quickly. 

•  The  second  ROI  focuses  on  the  impact  of  an  investment  in  ATOS  in  the 
arena  of  munitions  environmental  data.  This  is  more  theoretical  because 
data  needs  to  be  collected  and  analyzed  over  a  relatively  long  period  of 
time  in  order  to  address  effectively  the  savings  that  ATOS  can  provide. 

1.  Inventory  Management  Process  Return  on  Investment  Analysis 

To  do  the  first  ROI  analysis  of  measuring  the  impact  of  an  investment  in  ATOS 
infrastructure  on  the  Inventory  Management  process  and  the  successful  management  of 
DoD’s  munitions  stockpiles  implementing  ATOS  ,  I  had  to  gather  cost  estimates  for  the 
Operation  &  Support  to  capture  the  As-Is  cost.  For  clarification,  the  As-Is  costs  are  the 
costs  that  are  occurring  in  the  current  situation,  which  is  a  world  without  the 
implementation  of  ATOS.  To  determine  the  To-Be  cost  (that  is,  the  costs  that  would 
occur  in  a  future  situation,  a  world  with  implementation  of  ATOS  I  required 
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•  Cost  estimates  for  the  initial  investment  to  put  ATOS  in  place,  and 

•  Percentage  reductions  in  Operation  &  Support  costs  that  are  due  to  the 
implementation  of  ATOS. 

Since  ATOS  has  not  yet  been  implemented,  I  was  able  to  gather  just  cost 
information  that  has  been  expended  thus  far  or  planned  to  be  expended  to  implement  a 
portion  of  ATOS.  An  example  of  this  kind  of  expenditure  is  for,  the  inventory 
management  process.  To  develop,  or  forecast,  the  To-Be  cost  proved  to  be  a  challenge, 
especially  when  it  came  to  the  environmental  because  it  requires  the  collection  of 
munitions  environmental  data  over  time  to  determine  effectively  the  percentage 
reduction.  Only  the  implementation  of  an  ATOS  pilot  aimed  to  capture  munitions 
environmental  data  over  a  long  period  of  time  will  identify  a  sensible  percentage 
reduction.  After  many  discussions  with  SMEs  currently  working  in  the  ATOS  project,  I 
was  able  to  get  cost  estimates  that  I  could  use  to  proceed  with  the  ROI  analysis.  Cost 
estimates  for  other  portions  of  the  analysis  were  developed  on  a  best  guess  basis.  Table  2 
below  displays  the  cost  estimates  used  in  the  first  ROI  analysis  for  a  notional  five 
munitions  magazine.  It  should  be  noted  that  the  implementation  of  these  five  magazines 
is  assumed  to  be  what  would  be  needed  for  four  Hellfire  Missile  magazines  and  one 
Standard  Missile  magazine. 
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ATOS  Work  Breakdown 

Structure 

As-ls  Cost 

(Without 

ATOS) 

Reduction 

(With 

ATOS) 

To-Be  Cost 

(With  ATOS) 

Difference 

in  Cost 

Investment  ($K) 

*  Hardware/Installation 

N/A 

N/A 

77 

N/A 

*  Modelling  Validation  (1) 

N/A 

N/A 

1,250 

N/A 

(Annual) 

*  Munitions  Inventory  Management 

*  Maintenance/Quality  Evaluation 

*  Munitions  Demilitarization 

*  Hardware  Replacement 


N/A 


1,200 

37.5 

37.8 


50% 

50% 

90% 

N/A 


600 

18.8 

3.8 

1.9 


N/A 


600 

18.8 

34.0 


Environmental  ($K) 


*  Mishap  Cost _ 

*  Quality  Evaluation  Cost 

*  Corrosion  Maintenance  Cost 


204.6 

37.5 

537.5 


50% 

83% 

50% 


102.3 

6.4 

268.8 


102.3 

31.1 

268.8 


Grand  Total  Cost  ($K) 


2054.9 


1001.9 


T05370 


(1)  Modelling  Validation  cost  of  $1,250K  is  spread  over  a  two-year  period:  $625K/Year. 


Table  2.  Estimates  Used  in  the  ROI  Analysis  for  a  Notional  Five  Munitions 

Magazine  (All  Estimates  are  in  $K). 


There  is  no  formal  Navy  guidance  that  lays  out  the  initial  investment  of  the 
implementation  of  an  ATOS  infrastructure  at  a  munitions  facility  because  a  fully 
implemented  ATOS  infrastructure  has  yet  to  be  implemented.  What  does  exist  are  costs 
of  partially  implemented  ATOS  scenarios  that  were  done  to  answer  questions  posed  by 
DoD  elements,  such  as  the  Air  Force  Operational  Test  and  Evaluation  Center  (AFOTEC) 
which  conducted  a  Military  Utility  Assessment  of  ATOS  to  determine  its  utility  to  the 
warfighter.  The  report  from  this  assessment  may  be  found  in  Appendix  B  of  this  thesis. 

In  a  30  July  2004  Memorandum,  the  Office  of  Secretary  of  Defense  (OSD)  Under 
Secretary  of  Logistics  directed  the  implementation  of  RFID  across  the  Department  of 
Defense  with  full  implementation  to  be  competed  in  FY07.  In  an  effort  to  meet  the 
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dateline,  OPNAV  N4  has  taken  the  lead  in  the  research  and  identification  of  a  robust 
RFID  capability,  which  will  provide  the  highest  Return  on  Investment  and  that  requires 
minimal  installation  and  out  year  maintenance  costs.  OPNAV  has  identified  two  Naval 
Weapons  Stations,  Seal  Beach,  California,  and  Yorktown,  Pennsylvania,  to  implement  an 
ATOS  pilot.  Phase  I  of  this  pilot  will  demonstrate  how  inventory  can  be  accomplished  in 
real  time  with  a  very  high  degree  of  accuracy  and  track  location  of  sub-assembly 
components  of  high  value  missiles.  The  extent  of  this  implementation  will  be  to  outfit 
four  Hellfire  Missile  magazines  and  one  Standard  Missile  magazine  with  the  capability  to 
provide  real  time  inventory  and  asset  data  visibility  to  Ammunition  Distribution  & 
Control  (AD&C).  Additionally,  this  part  of  the  test  will  demonstrate  the  potential  ability 
to  change  current  supply  chain  management  within  and  between  activities. 

To  capture  the  As-Is  cost,  I  used  a  combination  of  the  following: 

•  FYOO  Army  Demilitarization  Cost 

•  Prior  NPS  work 

•  1994  Incident  Cost  Report 

•  Estimate  to  outfit  five  munitions  magazines 

•  FY04  USAF  Corrosion  Maintenance  Cost  Report 

•  SMEs  best  guess  cost  estimates 

SMEs  want  to  make  it  clear  that  the  figures  provided  are  estimates  and  these 
estimates  are  different  from  munitions  facility  to  munitions  facility. 

To  capture  the  To-Be  cost  of  the  Inventory  Management  process  was  a  much 
harder  problem.  This  is  because,  as  previously  mentioned,  there  is  not  enough  data  to 
determine  the  percentage  reduction  that  ATOS  would  provide.  The  percentage 
reductions  that  I  used  are  best  guess  estimates  and  need  to  be  validated  once  data  is 
collected  and  analyzed  from  a  pilot  project. 
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a.  Baseline  Operation  &  Support  ROI  Analysis 
This  ROI  analysis  model  is  used  as  the  baseline  for  the  Operation  & 
Support  of  a  notional  five  munitions  magazine  at  a  Naval  Weapons  Station.  In  this 
baseline  model,  data  is  taken  from  Table  2  above,  which  includes 

•  S1.327M  to  implement  an  ATOS  infrastructure  in  this  notional  five  munitions 
magazine,  time  phased  as  follows: 

o  Year  1 -$0.7 12M 

o  Year  2  -  $0.625M 

•  $1 .275  annual  costs  for  the  Operation  &  Support 

To  account  for  inflation,  I  used  the  inflation  indices  provided  by  the  Naval 
Cost  Analysis  Division  (NCAD).  These  indices  are  available  at 
http://www.ncca.navy.mil/service/inflation.cfm. 

For  net  present  value  computations,  I  assumed  a  10%  discount  on  the 
savings  produced  every  year  starting.  These  savings  begin  in  YR  1,  under  the  assumption 
that  implementation  of  ATOS  occurs  in  YR  0. 

Figure  8  below  displays  the  cumulative  Operation  &  Support  and 
Investment  cost  for  the  As-Is  and  the  To-Be  for  the  management  of  the  five  notional 
munitions  magazines.  Compared  to  the  amount  invested,  I  calculate  a  break  even  point  in 
24  months.  That  is,  the  notional  five  munitions  magazines  at  the  Naval  Weapons  Station 
will  obtain  full  return  on  the  initial  investment  in  24  months. 
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Cumulative  Operation  &  Support  and  Investment  Cost  ($K) 


Cum  As-ls  Cost  ($M) 
Cum  To-Be  Cost  ($M) 


Figure  8.  Cumulative  Operation  &  Support  and  Investment  Cost. 


Figure  9  below  displays  the  Net  Present  Value  (NPV)  of  Operation  & 
Support  and  Investment  savings.  I  assumed  a  10%  discount  on  the  savings  produced 
every  year  starting  on  YR  1  since  I  am  assuming  implementation  of  ATOS  in  YR  0. 
With  these  assumptions,  I  calculate  that  the  notional  five  munitions  magazines  at  the 
Naval  Weapons  Station  can  save  approximately  $5.2M  (undiscounted  savings)  and 
$2.8M  (discounted  savings)  in  a  ten-year  period  by  implementing  ATOS  in  the  Inventory 
Management  process.  The  Return  on  Investment  is  calculated  at  214  %.  That  is,  if 
S1.3M  was  invested  for  10  years  at  10.8%  compounded  interest,  one  would  save  $2.8M 
which  is  214%  over  the  10-year  period,  or  almost  11%  annual,  compounded  ROI. 
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Figure  9.  Net  Present  Value  of  Operation  &  Support  and  Investment  Savings. 

b.  Baseline  Environmental  ROI  Analysis 

This  ROI  analysis  model  is  used  as  the  baseline  for  the  Environmental  cost 
of  a  notional  five  munitions  magazines  at  a  Naval  Weapons  Station.  In  this  baseline 
model,  I  assumed  it  would  cost  $1.3M  to  implement  an  ATOS  infrastructure  in  the 
notional  five  munitions  magazines.  It  currently  costs  the  notional  Weapons  Station 
$0.8M  due  to  environmental  conditions.  To  account  for  inflation,  I  used  the  inflation 
indices  provided  by  the  Naval  Cost  Analysis  Division  (NCAD).  I  assumed  a  10% 
discount  on  the  initial  investment  every  year  starting  on  YR  1  since  I  am  assuming 
implementation  of  ATOS  in  YR  0. 

Figure  10  below  displays  the  cumulative  environmental  costs  for  the  As-Is 
and  the  To-Be  for  the  management  of  the  munitions  in  the  five  notional  munitions 
magazines.  Compared  to  the  amount  invested,  I  calculate  that  the  notional  five  munitions 
magazines  at  the  Naval  Weapons  Station  will  obtain  full  return  on  the  initial  investment 
in  38  months. 
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Cumulative  Environmental  and  Investment  Cost  ($K) 


Cum  As-ls  Environmental  Cost 
($M) 


Cum  To-Be  Environmental  Cost 
($M) 


Figure  10.  Cumulative  Environmental  and  Investment  Cost. 


Figure  1 1  below  displays  the  Net  Present  Value  (NPV)  of  Environmental 
and  Investment  savings.  I  assumed  a  10%  discount  on  the  savings  produced  every  year 
starting  on  YR  3  since  I  am  assuming  implementation  of  ATOS  in  YR  0  and  the 
collection  of  munitions  environmental  data  for  two  years  to  collect  the  munitions 
environmental  data  required  for  analysis.  With  these  assumptions,  I  calculate  that  the 
notional  five  munitions  magazines  at  the  Naval  Weapons  Station  can  save  approximately 
$2.7M  (undiscounted  savings)  and  $1.3  (discounted  savings)  at  the  end  of  YR  10  The 
Return  on  Investment  is  calculated  at  99  %.  That  is,  if  $1.3M  was  invested  for  10  years 
at  10.8%  compounded  interest,  one  would  save  $2.7M  which  is  99%  over  the  10-year 
period,  or  almost  7%  annual,  compounded  ROI. 
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Net  Present  Value  of  Environmental  and  Investment  Savings  ($K) 
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Figure  1 1 .  Net  Present  Value  of  Environmental  and  Investment  Savings. 

c.  Baseline  Cumulative  Total  ROI  Analysis 

This  ROI  analysis  model  is  used  as  the  baseline  for  the  combination  of 
Operation  &  Support  and  Environmental  costs  of  munitions  at  the  Naval  Weapons 
Station.  In  this  baseline  model,  I  assumed  it  would  cost  $1.3M  to  implement  an  ATOS 
infrastructure  in  a  notional  five  munitions  magazine  Naval  Weapons  Station.  It  currently 
costs  the  Weapons  Station  $2M  for  the  Operation  &  Support  of  the  five  magazines.  To 
account  for  inflation,  I  used  the  inflation  indices  provided  by  the  Naval  Cost  Analysis 
Division  (NCAD).  I  assumed  a  10%  discount  on  the  savings  produced  every  year 
starting  on  YR  1  since  I  am  assuming  implementation  of  ATOS  in  YR  0. 

Figure  12  below  displays  the  cumulative  total  cost  for  the  As-Is  and  the 
To-Be  for  the  management  of  the  five  munitions  magazines.  Compared  to  the  amount 
invested,  I  calculate  that  the  notional  five  munitions  magazines  at  the  Naval  Weapons 
Station  will  obtain  full  return  on  the  initial  investment  in  less  than  one  year. 
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Figure  12.  Cumulative  Total  Costs. 

Figure  13  below  displays  the  Net  Present  Value  (NPV)  of  cumulative  total 
savings.  I  assumed  a  10%  discount  on  the  savings  produced  every  year  starting  on  YR  1 
for  the  Operation  &  Support  and  YR  3  for  Environmental  since  I  am  assuming 
implementation  of  ATOS  in  YR  0.  With  these  assumptions,  I  calculate  that  the  notional 
five  munitions  magazines  at  the  Naval  Weapons  Station  can  save  approximately  $9.2M 
(undiscounted  savings)  and  $5.3M  (discounted  savings)  at  the  end  of  YR  10.  The  Return 
on  Investment  is  calculated  at  403  %.  That  is,  if  $1.3M  was  invested  for  10  years  at 
10.8%  compounded  interest,  one  would  save  $5.3M  which  is  403%  over  the  10-year 
period,  or  almost  18%  annual,  compounded  ROI. 
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Net  Present  Value  of  Cumulative  Total  Savings  ($K) 
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Figure  13.  Net  Present  Value  of  Cumulative  Total  Savings. 


2.  Theoretical  Environmental  Return  on  Investment  Analysis 

As  with  the  case  with  Inventory  Management,  we  do  not  have  historical  data  on 
what  percentage  reductions  in  Operation  &  Support  costs  ATOS  implementation  would 
provide.  We  do  not  have  any  data  to  substantiate  such  an  estimate,  so  we  used 
percentage  reductions  that  SMEs  believe  that  ATOS  can  provide  over  time.  For  those 
estimates  that  SMEs  were  not  comfortable  in  providing,  we  provide  an  estimate  based  on 
our  professional  judgment  coupled  with  the  discussions  we  had  with  SMEs. 

SMEs  claim  that  it  would  take  approximately  ten  years  of  environmental 
munitions  data  collection  to  begin  analysis  on  the  data  collected.  We  are  in  the  analytical 
position  of  the  previous  paragraph.  One  thing  is  for  certain;  all  SMEs  are  in  agreement 
that  ATOS  has  potential  savings  in  Quality  Evaluation,  Demilitarization,  and  Corrosion 
Maintenance.  As  previously  mentioned,  Mr.  Roger  Swanson,  is  confident  that  ATOS  can 
reduce  QE  expenditures  as  much  as  83%.  Additionally,  ATOS  would  allow  all  munitions 
to  partake  in  the  QE  process  vice  just  the  current  selected  few.  Furthermore,  if  during  the 
munitions  QE  process,  the  munitions  undergoing  testing  are  found  to  be  faulty,  the  entire 
batch  of  munitions  manufactured  on  the  same  date  is  removed  from  the  inventory  and 
taken  to  be  demilitarized.  The  current  QE  process  assumes  that  if  a  sample  of  a  batch 
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manufactured  on  a  specific  date  is  bad,  no  further  testing  is  done.  The  entire  batch  is 
removed  from  inventory  to  prevent  personnel  and  property  damages.  With  the  analysis 
of  the  collection  of  munitions  environmental  data,  QE  personnel  would  be  able  to  notify 
munitions  sites  what  munitions  to  remove  from  inventory.  Mr.  John  Backes,  NSWC, 
Indian  Head,  Code  El 3 A,  says  that  the  way  of  managing  munitions  in  the  future  should 
be  “management  by  individual  instead  of  entire  lots.”  The  following  is  an  excerpt  from 
an  e-mail  that  recaps  the  points  discussed  with  an  SME  on  his  support  of  ATOS. 

1)  I  fully  support  ATOS  or  a  similar  system  that  will  provide  good 
environmental  data. 

2)  Management  by  individuals  instead  of  entire  lots  should  be  the  way  of 
the  future. 

3)  We  can  only  test  a  small  sample  (usually  every  3  years)  of  the  entire 
population.  We  typically  test  about  30  samples  and  in  many  cases  there 
are  many  more  lots.  We  also  do  not  have  good  information  on  the 
exposure  of  this  sample  and  how  well  it  represents  the  entire  population. 

4)  In  the  future,  I  think  we  can  develop  a  model  that  quantifies  how  much 
damage  occurs  from  each  environmental  stressor.  The  model  would 
predict  when  the  unit  was  approaching  a  critical  level  of  cumulative 
damage.  The  units  would  then  be  removed  from  the  population.  Early 
removals  would  be  tested  to  verify  the  accuracy  of  the  model.  For  items 
that  are  susceptible  to  thermal  damage,  1  day  at  150  degrees  might  cause 
the  same  amount  of  damage  as  20  days  at  120  degrees  or  1  year  at  70 
degrees. 

5)  The  biggest  benefit  of  this  capability  would  be  an  improvement  in  our 
ability  to  accurately  monitor  and  predict  the  quality  of  weapons  and 
remove  defective  weapons  before  they  become  a  safety  or  reliability 
problem.  It  is  much  better  to  predict  and  remove  these  weapons  instead  of 
finding  the  problem  when  the  fleet  attempts  to  use  the  item. 

In  demilitarization,  I  speculate  that  DoD  will  be  able  to  save  as  much  as  90% 
because  munitions  will  only  be  demilitarized  when  it  is  actually  known  for  certain  that 
munitions  have  exceeded  their  serviceability  and  pose  a  danger  to  personnel  and 
property.  According  to  Mr.  John  Backes,  when  munitions  are  dropped,  there  is  no  testing 
on  the  spot  of  the  incident  to  determine  the  status  of  the  dropped  munitions.  The  dropped 
munitions  need  to  be  shipped  to  a  facility  where  testing  can  be  done  to  determine  the 
status  of  these  munitions.  If  one  of  the  munitions  is  found  to  be  damaged  due  to  the 
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dropped,  the  entire  pallet  that  was  dropped  is  demilitarized.  When  this  occurs,  munitions 
need  to  be  shipped  to  replace  the  dropped  munitions  costing  DoD  additional  monies  in 
shipment  and  munitions  replacement,  not  to  mention  a  possible  delay  in  mission 
accomplishment.  Although  incidents  involved  dropping  of  ordnance  do  not  occur 
frequently,  I  speculate  that  on  the  worst  case,  50%  reduction  in  cost  can  be  saved  if 
personnel  know  what  dropped  munitions  have  received  damages  and  need  to  be 
demilitarized  without  further  testing.  This  figure  can  only  be  validated  over  time  with  the 
collection  of  munitions  environmental  data. 

In  corrosion  control,  I  speculate  the  availability  of  environmental  munitions  data 
can  reduce  the  corrosion  maintenance  expense  by  at  least  50%.  As  previously 
mentioned,  in  FY04  it  cost  the  USAF  $43M  in  munitions  corrosion  maintenance.  The 
access  to  information  about  the  environmental  conditions  munitions  are  or  have  been 
exposed  to  can  significantly  assist  maintenance  personnel  in  revising  munitions 
maintenance  schedules  to  ensure  maximum  munitions  serviceability  and  reliability. 


G.  SENSITIVITY  ANALYSIS 

Sensitivity  analysis  is  a  procedure  to  determine  the  sensitivity  of  the  outcomes  of 
an  alternative  to  changes.  If  a  small  change  in  a  parameter  results  in  relatively  large 
changes  in  the  outcomes,  the  outcomes  are  said  to  be  sensitive  to  that  parameter.  This 
may  mean  that  the  parameter  has  to  be  determined  very  accurately  or  that  the  alternative 
has  to  be  redesigned  for  low  sensitivity.  Sensitivity  analysis  helps  to  determine  a  range 
of  plausible  inputs  to  be  considered  when  there  is  uncertainty  about  the  true  value  of  an 
input. 

In  this  thesis  the  cost  estimates  used  in  the  ROI  analysis  were  based  on  personal 
professional  judgment.  They  can  be  validated  only  when  an  ATOS  pilot  is  implemented, 
and  the  data  collected  from  this  pilot  are  analyzed.  The  initial  investment,  for  example, 
will  not  be  the  same  at  every  munitions  facility  because  the  initial  investment  depends  on 
the  size  of  the  facility  and  the  extent  of  the  ATOS  implementation.  For  this  reason,  I 
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conducted  a  sensitivity  analysis  varying  the  initial  investment  and  the  percentage 
reductions  in  various  Operating  and  Support  WBS  Elements,  keeping  all  other  variables 
the  same. 

Table  3  provides  the  results  of  sensitivity  analyses  in  which  the  value  of  the  initial 
investment  is  varied.  Recall  that  the  baseline  value  for  the  initial  investment  is  $77K.  In 
these  sensitivity  analyses,  the  initial  investment  is  raised,  in  a  step-wise  way,  to  $200K, 
then  to  $400K,  and  finally  to  $600K.  This  latter  figure  represents  an  expansion  of  almost 
ten  times  the  baseline  investment  costs.  Table  3  displays  the  time  in  months  when  the 
notional  Naval  Weapons  Station  will  reach  the  break  even  point,  that  is,  the  time  it  takes 
to  obtain  full  return  on  the  initial  investment  in  Operation  &  Support  given  initial 
hardware  cost  of  $200K,  $400K,  and  $600K  respectively.  Note  that  while  the  cost  of 
investment  expands  by  almost  ten  times  the  baseline  investment  costs,  the  break  even 
time  expands  by  much  less,  not  even  doubling.  This  suggests  that  the  attractiveness  of  an 
ATOS  investment  is  very  robust. 


Initial  Hardware  Cost  ($K) 

Payback  Period  (Months) 

77  (baseline) 

24 

200 

26 

400 

32 

600 

37 

Table  3.  Payback  Periods  in  Operation  &  Support. 


To  satisfy  the  optimistic  and  pessimistic  use  of  SMEs  about  the  Operation  & 
Support  savings  that  ATOS  can  provide,  I  increased  and  decreased  the  percentage 
reductions  in  the  Operation  &  Support  keeping  all  other  variables  constant,  to  calculate 
the  savings  and  the  ROIs  within  the  same  time  frames. 

Table  4  below  displays  the  percentage  reductions  that  I  used  in  the  sensitivity 
analyses  1  and  2. 
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Operation  &  Support  (Annual) 

Baseline  % 

Reduction 

Sensitivity 

Analysis  1 
(Increase  % 
Reduction) 

Sensitivity 

Analysis  2 
(decrease  % 
Reduction) 

■  Munitions  Inventory  Management  Process  Cost 

50 

75 

40 

■  Demilitarization/Disposal  Cost 

90 

90 

50 

■Maintenance/Quality  Evaluation  Cost 

50 

90 

50 

Table  4.  Percentage  Reductions  in  Operation  &  Support. 


Table  5  displays  the  To-Be  cost,  savings,  the  payback  period,  and  the  ROI  for 
each  case  presented  in  Table  4. 


Baseline 

Analysis 

Sensitivity 
Analysis  1 

(Increase  % 

Reduction) 

Sensitivity 
Analysis  2  j 

(decrease  % 

Reduction) 

Investment  ($M) 

1.3 

1.3 

1.3 

10-Year  As-ls  Cost  ($M) 

14.3 

14.3 

14.3 

10-Year  To-Be  Cost  ($M) 

8.3 

4.8 

10 

10-Year  Discounted  Savings  ($M) 

2.8 

4.8 

2 

Pay  Back  Period  (Months) 

24 

<  12 

32 

Total  ROI  (%) 

214 

360 

152 

Annual  Compounded  ROI  (%) 

11 

17 

7 

Table  5.  Sensitivity  Analysis  on  Changes  of  the  Percentage  Reduction  in  Operation 

&  Support. 
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IV.  OBSERVATIONS  AND  RECOMMENDATIONS 


A.  OBSERVATIONS 

•  Throughout  this  thesis,  I  have  emphasized  many  times  that  ATOS  is  not  a 
replacement  for  the  current  policy  of  ordnance  management.  Rather,  the 
concept  of  ATOS  is  to  enhance  the  current  ordnance  management  processes 
for  the  effective  management  of  DoD’s  large  munitions  stockpiles. 

•  Technology  required  to  implement  ATOS  is  COTS  technology.  There  is  no 
time  delay  in  obtaining  the  hardware  for  full  implementation.  Of  course,  as 
requirements  and  security  for  ATOS  changes, 

•  The  methodology  for  doing  ROI  analysis  associated  with  the  implementation 
of  ATOS  is  well  understood,  and,  with  appropriate  data,  can  be  developed. 

•  The  data  to  support  ROI  analysis  associated  with  the  implementation  of 
ATOS  are  not  fully  available,  and  they  need  to  be  developed.  In  some  cases, 
these  data  need  to  be  developed  over  multi-year  time  frames. 

•  Based  on  projects  done  thus  far  (e.g.,  the  Military  Utility  Assessment  by 
AFOTEC  (Appendix  B)),  ATOS  can  provide  the  capability  to  enhance  the 
effective  management  of  the  large  Department  of  Defense  munitions 
stockpiles.  See  the  Recommendations  section  below  for  the  logical  follow-on 
to  this  observation. 

•  Mr.  Roger  Swanson  and  Mr.  Mark  Mentikov,  Subject  Matter  Experts,  do  warn 
the  decision  makers  having  the  final  decision  in  making  ATOS  a  program  of 
record,  that  ATOS  savings  and  benefits  will  not  be  reaped  in  all  areas  of 
interest  simultaneously.  Rather,  the  longer  the  system  is  implemented,  the 
more  attractive  will  the  dividends  be,  especially  in  the  environmental  data 
collection.  See  the  Recommendations  section  below  for  the  logical  follow-on 
to  this  observation. 

•  Subject  Matter  Experts  claim  that  there  is  not  enough  data  on  hand  to 
determine  the  savings  with  ATOS  if  the  environmental  condition  munitions 
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have  experienced  was  known.  See  the  Recommendations  section  below  for 
the  logical  follow-on  to  this  observation. 

•  Millions  of  dollars  are  spent  every  year  in  corrosion  maintenance  and  Quality 
Evaluation  to  ensure  munitions  are  mission  ready.  These  millions  of  dollars 
can  be  reduced  if  QE  personnel  had  better  knowledge  of  the  status  of  all 
munitions  in  inventory.  This  is  not  currently  the  case.  For  this  reason,  the 
RFID  tags  attached  to  munitions  pallets  need  the  capability  to  collect  the 
environmental  data  that  is  required  by  QE  personnel  to  input  into  models  to 
provide  Ordnance  Managers  valuable  information  about  the  status  of  their 
munitions  in  inventory.  The  more  information  is  known  about  the  condition 
of  the  munitions  in  theater,  the  less  number  of  munitions,  due  to  their 
reliability,  will  be  needed  to  accomplish  the  warfighters’  assigned  missions. 


B.  RECOMMENDATIONS 

•  A  complete  implementation  of  ATOS  to  capture  munitions  environmental 
data  to  be  analyzed  in  order  to  predict  the  serviceability  and  reliability  of 
munitions.  Currently  no  personnel  know  what  percentage  reduction  ATOS 
can  provide;  one  could  only  speculate.  Only  a  pilot  when  implemented  for  a 
long  period  of  time,  say  10  years,  can  validate  our  speculations.  It  is  critical 
that  a  commitment  in  implementing  an  ATOS  pilot  be  made  soon  to 
commence  collecting  the  benefits. 

•  A  full  scale  ATOS  pilot  project  at  a  munitions  location,  such  as,  Seal  Beach, 
needs  to  be  funded  and  implemented  in  order  to 

•  collect  the  required  data  in  order  to  validate  the  results  from  previous  analysis, 
and 

•  support  and  provide  a  better  argument  as  to  why  ATOS  is  the  way  to  go  in 
Ordnance  Management. 

•  To  establish  an  ATOS  implementation  plan  DoD  wide,  a  study  on  optimizing 
the  placement  of  ATOS  needs  to  be  initiated.  This  will  help  decision  makers 
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in  determining  the  optimal  locations  that  provide  the  greatest  savings  due  to 
the  large  munitions  stockpiles.  For  example,  small  munitions  facilities  where 
munitions  do  not  have  a  high  cycle  rate  may  not  be  a  high  priority  for  the 
implementation  of  ATOS. 

•  RFID  tags  attached  to  munitions  pallets  need  the  capability  to  collect  the 
environmental  data  that  is  required  by  QE  personnel  to  input  into  models  to 
provide  Ordnance  Managers  valuable  information  about  the  status  of  their 
munitions  in  inventory. 

C.  RECOMMENDATIONS  FOR  FUTURE  RESEARCH 

This  thesis  provides  an  initial  glimpse  of  the  Return  on  Investment  analysis  of  the 
savings  and  benefits  that  ATOS  has  the  potential  of  providing  the  Department  of  Defense 
in  managing  its  large  munitions  stockpiles.  While  the  purpose  of  this  thesis  was  to 
provide  a  methodological  approach  for  conducting  a  Business  Case  Analysis  for  the 
ATOS  ACTD,  there  are  many  opportunities  to  capture  other  complexities  and  variability 
associated  with  ATOS,  including  the  following. 

•  It  would  be  beneficial  to  the  Department  of  Defense  to  know  an  ATOS 
implementation  location  plan  to  guarantee  savings  and  benefits  at  the 
earliest  stages  of  the  ATOS  implementation.  An  optimization  model 
would  provide  the  order  in  which  munitions  sites  are  fielded  to  ensure  the 
sites  with  the  highest  cycle  rate  of  munitions  are  implemented  first. 

•  Although  models  may  already  exist  that  provide  limited  predictability 
about  the  conditions  of  only  certain  munitions,  robust  models  will  be 
required  to  process  the  environmental  munitions  data  collected  to 
effectively  calculate  munitions  service  life  and  reliability. 

•  Support  and  participate  in  the  implementation  of  the  pilot  project  and 
collect  the  data  required  to  conduct  a  Business  Case  Analysis  to  further 
assist  the  decision  makers  decision  in  making  ATOS  a  program  of  record. 
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APPENDIX  A.  ACTDS/JCTDS  FY95  -  FY  05 


Year 

ACTD  Acronym 

ACTD  Name 

FY2005 

ASAP 

Actionable  Situational  Awareness  Pull 

FY2005 

CUGR 

Chemical  Unmanned  Ground  Reconnaissance 

FY2005 

COSMOS 

Coalition  Secure  Management  and  Information  System 

FY2005 

EOS 

Epidemic  Outbreak  Surveillance 

FY2005 

JCRE 

Joint  Coordinated  Real  Time  Engagement 

FY2005 

JEERCE 

Joint  Enhanced  Explosion  Resistant  Coating  Exploitation 

FY2005 

JFP 

Joint  Force  Projection 

FY2005 

MSAT 

Medial  Situational  Awareness  in  Theater 

FY2005 

RARE 

Rapid  Airborne  Reporting  &  Exploitation 

FY2005 

Sea  Talon 

Sea  Talon 

FY2005 

Sea  Eagle 

Sea  Eagle 

FY2005 

SLED 

SOCOM  Long  Endurance  Demonstrator 

FY2005 

VIPER  Strike 

Gunship  Standoff  Precision  Munition 

FY2005 

TACSAT-2 

TACSAT-2  Roadrunner 

FY2005 

WDL 

Weapon  Data  Link 

FY2004 

AT3 

Advanced  Tactical  Targeting  Technology 

FY2004 

ARGCS 

Agile  Rapid  Global  Combat  Support 

FY2004 

CORSOM 

Coalition  Reception  Staging  &  Onward  Movement 

FY2004 

COSINE 

Coalition  Shared  Intel  Network  Environment  -  DEMO  COMPLETE 

FY2004 

fits 

Future  Tactical  Truck  System 

FY2004 

JPADS 

Joint  Precision  Airdrop  System 

FY2004 

J-USC2 

Joint  Unmanned  Sys  Common  Control 

FY2004 

MANPACK 

MANPACK 

FY2004 

MAJIIC 

Multi-Sensor  Aerospace/Ground  Joint  ISR  Interoperability  Coalition 

FY2004 

MAGNUM 

MAGNUM 

FY2004 

PLATO 

Protected  Landing  and  Take-Off 

FY2004 

PSYOP 

Psychological  Operations  (PSYOP)  Global  Reach 

FY2004 

TEBO 

Theater  Effects  Based  Operations 

FY2003 

AJCN 

Adaptive  Joint  C4ISR  Node  -  DEMO  COMPLETE 

FY2003 

CB2 

Counter  Bomb/  Counter  Bomber 
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Year 

ACTD  Acronym 

ACTD  Name 

FY2003 

DCS 

Deployable  Cargo  Screening 

FY2003 

FOPEN 

Foliage  Pen  Syn  App  Rad 

FY2003 

GPE 

Gridlock  -  RESID  COMPLETE 

FY2003 

HAA 

High  Altitude  Airship 

FY2003 

JBFSA 

Joint  Blue  Force  Situational  Awareness  -  DEMO 
COMPLETE 

FY2003 

MS 

Midnight  Stand  (prev.  IT)  -  DEMO  COMPLETE 

FY2003 

NVCUA 

Night  Vision  Cave  &  Urban  Assault  -  DEMO  COMPLETE 

FY2003 

OW 

Overwatch 

FY2003 

TIM 

Tactical  IFSAR  Mapping 

FY2003 

TSV 

Theater  Support  Vessel 

FY2003 

TTD 

Tunnel  Target  Defeat 

FY2003 

UR 

Urban  Recon 

FY2002 

ADS 

Active  Denial  System 

FY2002 

ADW 

Agent  Defeat  Warhead 

FY2002 

AT 

Agile  Transportation 

FY2002 

BS 

Boundary  Step  -  RESID  COMPLETE 

FY2002 

CIA  COP 

Coalition  Information  Assurance  Common  Operational 
Picture 

FY2002 

CASPOD 

Contamination  Avoidance  at  Seaports  of  Debarkation  - 
DEMO  COMPLETE 

FY2002 

EUAV 

Expendable  Unmanned  Aerial  Vehicle  -  RESID 

COMPLETE 

FY2002 

HLSC2 

Homeland  Security  Command  and  Control  -  DEMO 
COMPLETE 

FY2002 

HYCAS 

Hyperspectral  Collection  and  Analysis 

FY2002 

JDSR 

Joint  Distance  Support  &  Response  -  DEMO  COMPLETE 

FY2002 

JEOD-KTOD 

Joint  Explosive  Ordnance  Disposal  -  DEMO  COMPLETE 

FY2002 

LASER 

Language  and  Speech  Exploitation  Resources  -  DEMO 
COMPLETE 

FY2002 

MAV 

Micro  Air  Vehicle 

FY2002 

PathF 

Pathfinder 

FY2002 

SIGINT 

SIGINT  Processing 
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1  Year 

ACTD  Acronym 

ACTD  Name  j 

FY2002 

Space-Based  MTI 

Space-Based  MTI 

FY2002 

SPARTAN 

SPARTAN 

FY2002 

TB 

Thermobarics  -  DEMO  COMPLETE 

FY2001 

ANID 

Active  Network  Intrusion  Defense  -  DEMO  COMPLETE 

FY2001 

ABA 

Adaptive  Battlespace  Awareness  -  RESID  COMPLETE 

FY2001 

ATL 

Advanced  Tactical  Laser 

FY2001 

ATOS 

Advanced  Technology  Ordnance  Surveillance  -  RESID 
COMPLETE 

FY2001 

ACMD 

Area  Cruise  Missile  Defense  -  RESID  COMPLETE 

FY2001 

CCID 

Coalition  Combat  ID  -  DEMO  COMPLETE 

FY2001 

CTL 

Coalition  Theater  Logistics  -  RESID  COMPLETE 

FY2001 

CAPS 

Coastal  Area  Protection  System  -  RESID  COMPLETE 

FY2001 

HSKT 

Hunter  Standoff  Killer  Team 

FY2001 

JAC 

Joint  Area  Clearance  -  RESID  COMPLETE 

FY2001 

LEWK 

Loitering  Electronic  Warfare  Killer 

FY2001 

NCCT 

Network-Centric  Collaborative  Targeting  (formerly 
NCCIS&R)  -  DEMO  COMPLETE 

FY2001 

PRESS 

Personnel  Recovery  Extraction  Survivability  aided  by  Smart 
Sensors 

FY2001 

TACMS-P 

Tactical  Missile  System  Penetrator  -  RESID  COMPLETE 

FY2001 

TIPS 

Theater  Integrated  Planning  System  -  DEMO  COMPLETE 

FY2000 

CINC21 

CINC  21  -  RESID  COMPLETE 

FY2000 

CAESAR 

coalition  Aerial  surveillance  ana  Keconraissance  -  Khi>iu 

COMPLETE 

FY2000 

C/NOFS 

Comm/Nav  Outage  Forecast  System 

FY2000 

COMWX 

Computerized  Operational  MASINT  Weather  -  RESID 
COMPLETE 

FY2000 

Umbrella) 

Content-Based  Info  Security 

FY2000 

GMSIS 

Global  Monitoring  of  Space  ISR  Systems  -  RESID 
COMPLETE 

FY2000 

GAPS 

Ground-to-Air  Passive  Surveillance  -  RESID  COMPLETE 

FY2000 

JISR 

Joint  Intelbgence,  Surveillance  &  Reconnaissance  -  RESID 
COMPLETE 
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Year 

ACTD  Acronym 

ACTD  Name 

FY2000 

MLAS 

Multiple  Fink  Antenna  System  -  RESID  COMPLETE 

FY2000 

QBolt 

Quick  Bolt  -  RESID  COMPLETE 

FY2000 

RestOps 

Restoration  of  Operations  -  RESID  COMPLETE 

FY2000 

TASC 

Tri-Band  Antenna  Signal  Combiner  -  RESID  COMPLETE 

FY1999 

BDAinJTT 

Battle  Damage  Assessment  in  the  Joint  Targeting  Toolbox  - 
RESID  COMPLETE 

FY1999 

CACE 

Coherent  Analytical  Computing  Environment  -  RESID 
COMPLETE 

FY1999 

COSMEC 

Common  Spectral  MASINT  Exploitation  -  RESID 
COMPLETE 

FY1999 

CEASE  II 

Compact  Environmental  Anomaly  Sensor  II  -  RESID 
COMPLETE 

FY1999 

FMP/D 

Force  Medical  Protection  /  Dosimeter  -  RESID 

COMPLETE 

FY1999 

HICIST 

Human  Intelligence  &  Counterintelligence  Support  Tools  - 
RESID  COMPLETE 

FY1999 

JMOT 

jomt  Medical uperations  /  telemedicine  -  Kti>iu 
COMPLETE 

FY1999 

JTL  (JLCP) 

Joint  Theater  Logistics  -  RESID  COMPLETE 

FY1999 

PRMS 

Personnel  Recovery  Mission  Software  -  RESID 

COMPLETE 

FY1999 

SUL 

Small  Unit  Logistics  -  RESID  COMPLETE 

FY1999 

TAMDI 

Theater  Air  &  Missile  Delense  interoperability  -  KbSlD 
COMPLETE 

FY1998 

ACOA 

Adaptive  Course  of  Action  -  RESID  COMPLETE 

FY1998 

C4I  for  CW 

C4I  for  Coalition  Warfare  -  RESID  COMPLETE 

FY1998 

HPM 

High  Power  Microwave  -  RESID  COMPLETE 

FY1998 

IA:AIDE 

Info  Assurance:  Automated  Intrusion  Detection 

Environment  -  RESID  COMPLETE 
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Year 

ACTD  Acronym 

ACTD  Name  ) 

FY1998 

JBREWS 

Joint  Biological  Remote  Early  Warning  System  -  RESID 
COMPLETE 

FY1998 

JCSE 

Joint  Continuous  Strike  Environ.  -  RESID  COMPLETE 

FY1998 

JMLS  (JLOTS) 

Joint  Modular  Lighter  System  -  RESID  COMPLETE 

FY1998 

LOSAT 

Line  of  Sight  Anti-Tank  -  RESID  COMPLETE 

FY1998 

Link- 16 

Link- 16  -  RESID  COMPLETE 

FY1998 

MDITDS 

Migration  Defense  Intelligence  Threat  Data  System  - 
RESID  COMPLETE 

FY1998 

PTI 

Precision  Targeting  Identification  -  RESID  COMPLETE 

FY1998 

SBSSO 

Space  Based  Space  Surveillance  Operations  -  RESID 
COMPLETE 

FY1998 

TPSO 

Theater  Precision  Strike  Ops  -  RESID  COMPLETE 

FY1998 

UGS 

Unattended  Ground  Sensors  -  RESID  COMPLETE 

FY1997 

Chem  Add-On 

Chemical  Add-On  to  Bio  Detection  -  RESID  COMPLETE 

FY1997 

Cons  Mgt 

Consequence  Management  -  RESID  COMPLETE 

FY1997 

CP  II 

Counterproliferation  II  -  RESID  COMPLETE 

FY1997 

ELB/JTFW 

COMPLETE 

FY1997 

IOPT  (IWPT) 

Info.  Operations  Planning  Tool  -  RESID  COMPLETE 

FY1997 

ICM 

Integrated  Collection  Mgt.  -  RESID  COMPLETE 

FY1997 

JAHUMS 

Joint  Advanced  Health  and  Usage  Monitoring  System  - 
DEMO  COMPLETE 

FY1997 

MOUT  (MOBA) 

Military  Ops  in  Urban  Terrain  -  RESID  COMPLETE 

FY1997 

RTV  (RBV) 

Rapid  Terrain  Visualization  -  RESID  COMPLETE 

FY1996 

ABP  Bio  Det 

Airbase/Port  Biological  Detection  -  RESID  COMPLETE 

FY1996 

BADD 

COMPLETE 
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Year 

ACTD  Acronym 

ACTD  Name 

FY1996 

CID 

Combat  Identification  -  RESID  COMPLETE 

FY1996 

CVS 

Combat  Vehicle  Survivability  -  RESID  COMPLETE 

FY1996 

cs 

Counter  Sniper  -  RESID  COMPLETE 

FY1996 

CPI 

Counterproliferation  I  -  RESID  COMPLETE 

FY1996 

JL 

Joint  Logistics  -  RESID  COMPLETE 

FY1996 

MALD  (SENGAP) 

Miniature  Air-Launched  Decoy  -  RESID  COMPLETE 

FY1996 

NAVWAR 

Navigation  Warfare  -  RESID  COMPLETE 

FY1996 

SAIP 

Semi-Automated  IMINT  Processing  -  RESID  COMPLETE 

FY1996 

THEL 

Tactical  High  Energy  Laser  -  DEMO  COMPLETE 

FY1996 

TUAV  ( Outrider j 

Tactical  UAV  -  RESID  COMPLETE 

FY1995 

AJP 

Advanced  Joint  Planning  -  RESID  COMPLETE 

FY1995 

BPI 

Boost  Phase  Intercept  -  RESID  COMPLETE 

FY1995 

CMD 

Cruise  Missile  Defense,  Phase  1  -  RESID  COMPLETE 

FY1995 

HAE  UAV 

High  Alt  Endurance  UAVs  -  RESID  COMPLETE 

FY1995 

JCM 

Joint  Countermine  -  RESID  COMPLETE 

FY1995 

(VERTREP) 

Low  Life  Cycle  Cost  Helo  -  RESID  COMPLETE 

FY1995 

MAE 

(Predator) 

Med  Alt  Endurance  UAV  -  RESID  COMPLETE 

FY1995 

PSTS 

Precision  SIGINT  Targeting  Sys.  -  RESID  COMPLETE 

FY1995 

P/RC-MRL 

Precision/Rapid  Counter-MRL  -  RESID  COMPLETE 

FY1995 

rvrr  i  (n-jui\, 

EFOGM ) 

Rapid  Force  Projection  Initiative  -  RESID  COMPLETE 

FY1995 

(JASP) 

Synthetic  Theater  of  War  -  RESID  COMPLETE 
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C  o ntexts  Advanced  T e chnol ogy  Ordnance  Surveillance 

Final  Report 


Executive  Summary . . . . . . 1 

The  Advanced  Technology  Ordnance  Surveillance  Advanced  Concept 
Technology  Demonstration  was  intended  to  demonstrate  an  automated 
system  that  could  be  used  to  enhance  the  management  of  munitions  and 
provide  near  real-time  environmental  surveillance  data  on  stored  critical 
munitions.  This  document  describes  the  results,  conclusions,  and  recom- 


SituntioD 


Detachment  1  Air  Force  Operational  Test  and  Evaluation  Center  conducted 
a  military  utility  assessment  to  determine  the  capability  of  the  Advanced 
Technology  Ordnance  Surveillance  system  to  provide  reliable  and  accurate 
environmental  surveillance  data  on  tagged  munitions  pallets  and  to  support 
munitions  management  tasks.  Data  were  collected  from  a  technical 
evaluation  at  the  Naval  Surface  Warfare  Center.  Indian  Head.  MD.  and 
from  three  operational  demonstrations  at  Miesau  Army  Ammunition  Depot. 
Miesau,  Germany;  Crane  Army  Ammunition  Activity  Depot.  Crane,  IN;  and 
Norfolk  Naval  Station.  Norfolk,  VA,  on  two  US  Navy  vessels  These 
events  were  conducted  between  March  2003  and  August  2004 


Execution . . . . . 11 

The  Technical  Manager  provided  19  detailed  scenarios  that  were  used  to 
assess  how  well  the  .Advanced  Technology  Ordnance  Surveillance  system 
supported  the  munitions  management  tasks  at  strategic  and  tactical  depots. 

Objective  data  were  collected  to  evaluate  system  performance  in  a 
realistic  operational  environment  and  to  determine  if  the  munitions  system 
met  US  European  Command  functional  requirements.  Questionnaires 
were  prodded  to  the  warfighters  to  capture  their  opinions  of  the  system's 
usability'  and  utility. 

Results . . . . . . . . . . . 17 


The  Advanced  Technology  Ordnance  Surveillance  system  demonstrated 
the  capability  to  enhance  the  numinous  management  logistics  processes 
and  provide  the  warfi  ghter  with  environmental  surveillance  information  on 
tagged  munitions  pallets.  Questionnaire  responses  and  comments  from 
warfighters  indicated  the  system  was  effective  in  providing  environmental 
surveillance  information  on  tagged  munitions  pallets  and  enhanced  the 
munitions  management  tasks. 


Conclusions:  and  Recommendations . 23 

Tie  Advanced  Technology'  Ordnance  Surveillance  system  demonstrated 
military  utility  but  could  be  unproved  by  enhancing  handheld  reader  data 
transfer  capability  to  support  up  to  1.000  records,  modifying  die  radio 
frequency  tag  so  munitions  quality  assurance  data  can  be  entered,  and 
evaluating  die  interoperability  of  the  system  w  ith  service  ammumrion 
automated  information  systems. 
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Executive  Summary 

The  purpose  of  the  Advanced  Technology  Ordnance  Surveillance  (ATOS)  Advanced  Concept  Technol¬ 
ogy  Demcnsfcatian  (ACT’D)  was  to  demonstrate  an  automated  system  that  was  designed  to  provide 
near-real  time  environmental  data  on  critical  munitions  and  use  the  latest  in  automatic  identification 
technologies  (ATT)  and  micro-electrica]  mechanical  sensors  (MEMS)  to  enhance  munitions  manage- 
men:.  This  doomnent  presents  the  results,  conclusions,  and  recommendations  derived  by  Detachment  1 
(Det  1)  Air  Force  Operational  Test  and  Evaluation  Center  (AFOTEC)  for  the  military  utility  assessment 
(MUA)  of  AIDS. 

The  ATOS  MUA  includes  results  obtained  during  a  technical  evaluation  (TEGEVAL)  and  three  opera¬ 
tional  demonstrations  conducted  from  March  2003  to  August  2004  at  four  locations.  Tee  TECEVAL 
was  held  at  Nava]  Sea  Systems  Command  (NAYSEAX  Indian  Head.  MD.  between  2S  March  2003 
and  16  July  200-  to  assess  ATOS  performance  in  a  controlled  laboratory  environment.  Tbe  Det  1 
AFOTEC  assessment  team  collected  performance  data  to  augment  data  collected  during  she  opera¬ 
tional  demonstrations.  The  first  operational  demonstration  was  held  at  Miesau  Army  Munitions  Depot. 
Miesau,  Germany  from  9  to  23  March  2004  and  assessed  ATOS  s  capability  to  support  dismbution  of 
munitions  from  a  "heater-level  depot.  The  second  operational  demonstration  was  held  at  Crane  Army 
Anymunihrvn  Activity  (CAAA);  Crane, IN',  from  12  to  23  April  2004  and  assessed  ATOS's  capability  to 
support  wholesale  disTibution  of  munitions  from  a  strategic-level  depot.  The  "hud  operational  demon¬ 
stration  was  held  at  Norfolk  Naval  Station.  Norfolk  VA  and  consisted  of  two  events.  The  first  event 
was  held  on  the  United  Stares  Ship  (UTSS)  Ponce  from  12  to  23  April  2004.  The  second  event  w  as 
conducted  in  wvo  parts:  the  first  part  was  held  on  the  pier  where  the  USS  Harry  S.  Tiuman  was  docked 
from  17  to  1 9  August  2004,  and  me  second  part  was  held  on  the  USS  Harry  S.  Truman  from  23  to  27 
August  2004.  These  three  maritime  events  assessed  AIOS  :s  capability  to  support  munitions  distribution 
aboard  naval  vessels. 

As  directed  by  US  European  Command  (USEUCOM),  the  MUA  assessed  ATOS '  capability  to  support 
environmental  surveillance  and  munitions  management.  The  environmental  surveillance  focused  on  the 
radio  frequency  (RF)  tag's  capability  to  collect  and  store  temperature  and  relative  humidity  (RH)  data. 
The  munitions  management  focused  on  AIDS3  cap-ability  to  support  and  enhance  munitions  manage¬ 
ment  tasks  (pallet  receipt,  inventory  mauitenance.  pahet  movement,  pallet  issue,  pallet  transfer,  and 
munitions  quality  assurance  [QA]).  In  addition  to  the  USECOM  functional  requirements.  Det  1 
AFOTEC  characterized  AIOS  system  capabilities  in  terms  of  training  component  ruggedness,  power 
requirements,  and  installation  requirements.  A  security'  assessment  was  planned  but  not  performed  due 
to  Sack  of  security  expertise  from  the  operators. 

The  ATOS  system  demonstrated  potential  military  utility  by  providing  the  warfighter  near-real  tune 
environmental  surveillance  data  and  supporting  five  out  of  the  six  munition  management  tasks  during  the 
demonstrations.  The  RF  tags  measured  and  recorded  temperance  and  RH  throughout  tee  demonstra¬ 
tions.  Although  the  RF  tags  performed  well  during  the  demonstrations,  some  of  the  warfighters  ex¬ 
pressed  concern  about  the  cost  of  the  RF  lag  and  the  fact  that  they  were  not  designed  to  be  reusable  on 
oner  munitions  pallets.  Also,  the  gravity-shock  (G-shock)  sensor  on  the  RF  tag  must  be  further  devel¬ 
oped  and  tested.  The  warfighters  indicated  that  ATOS  enhanced  munitions  management  tasks  and  that 
it  was  easy  to  install,  user  friendly,  easy  to  learn,  and  easy  to  operate.  Data  transfer  problems  between 
the  handheld  reader  (HHR.)  and  the  preprocessor  (PP)  diminished  effectiveness  of  pallet  receipt  and 
inventory  maintenance  tasks.  The  RF  tag  record  requires  additional  fields  to  accommodate  Tacking  of 
QA  inspections.  Tne  ATOS  system  demonsTated  good  support  for  pallet  movement,  issue,  and  Tansfer 
tasks. 

System reco emendations  fall  into  two  categories:  environmental  surveillance  and  munitions  manage¬ 
ment.  For  the  former,  RF  tags  require  three  upgrades:  time  date  stamp  of  temperature  and  RH 
readings  that  exceed  limits,  reusable  tags,  and  further  development  of  G-shock  sensors.  For  munitions 
management,  recommendations  focus  on  data  transfer  capabilities  and  the  addition  of  RF  tag  fields  to 
allow  tracking  of  QA  inspections. 
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Situation 


Background 

The  effective  management  of  the  large  Department  of  Defense  (DoD)  munitions  stockpile 
has  long  bees  hindered  by  labor-intensive  inventory  methods  and  stockpile  inaccuracies.  The 
current  process  involves  manual  data  entry  using  an  inventory  sheet  to  crack  and  monitor  die 
flow  of  caumtions.  The  loss  of  asset  visibility  due  to  stockpile  inaccuracies  a  iso  creates  a  host 
of  problems  for  the  acquisition  manager.  logisdcian.  storage  custodian,  and  the  warfighter. 
Overall  mission  readiness  is  degraded  because  needed  munitions  either  cannot  be  located,  or 
when  located,  the  serviceability  cannot  be  determined  because  the  current  surveillance 
methods  do  not  provide  die  critical  environmental  information  needed  to  determine  monitions 
serviceability.  Storage  conditions,  particularly  temperature  and  RH  profiles,  and  G- shock  can 
have  significant  impacts  on  munitions"  safety  and  reliability.  By  utilizing  the  latest  in  AIT  and 
MEMS.  the  warfighter  should  have  a  capability  that  provides  near-real-time  environmental 
data  and  automated  suppon  for  managing  the  complex.  DoD  munitions  stockpile. 

The  ATOS  ACTD  is  a  Department  of  the  Navy  ACID  sponsored  by  USEUCOM. 
USEUCOM  requested  De:  1  AFOTFC  to  conduct  a  MUA  of  the  ATOS  system.  This  report 
describes  the  assessment  of  ATOS  performance  using  data  from  the  XECEVAL  and  opera¬ 
tional  demonsTations.  It  includes  die  assessment  methodology-  data  collection  methods,  data 
analysis,  and  MU  A  results. 


System  Description 


The  ATOS  system  is  an  automated  system  that  provides  the  warfighter  a  capability  to  collect 
environmental  data  m  uear-real-dme  and  supports  munitions  management  tasks  on  stored 
munitions  pallets.  Tne  ATOS  system  consists  of  sik  major  components:  RE  tag.  EHR.  Reader 
Control  Unit  (RCU).  PR  environmental  database  (EDB).  and  an  interface  tc  service  ammuni¬ 
tion  automated  information  system  iAIS).  hi  addition,  radio  frequency  extenders  iRJE'j  are 
used  to  enhance  RF  coverage  inside  enclosed  magazines  or  depots.  The  EDB  and  interface 
to  Service  Ammunition  AJS  were  not  available  to  demonstrate  during  the  ACID.  Figure  1 
shows  connectivity  for  the  ATOS  system  components. 
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The  RF  tag  is  a  small  enclosure  attached  to  a  munition;]  pallet  using  an  RP  tag  holder,  The  RP 
tag  contains  Temperature.  RH  and  G-shock  sensor.  The  temperature  and  RPI  sensors  collect 
axvironniailfil  data  according  to  a  defined  schedule  (every  60  minutes  dining  the  ACID). 

Tne  RP  tag  also  has  a  receiver,  transmitter.  and  non-voiatiie  memory  to  receive:,  transmit,  and 
store  unique  asset  information  and  environmental  data. 

The  HHR  ls  a  portable  wireless  barcode  scanning  device  with  the  capability'  to  read  and  v.iite 
asset  data  to  and  from  the  RF  tags  and  read  lmear  and  2-dimensional  barcodes.  Using  a 
keypad  and  touch  screen,  the  users  can  upload  and  download  asset  information  to  and  from 
she  RP  tags  using  a  function  called  roll  call,  which  queries  the  RP  rag  to  identify  itself  and 
provide  any  changes  to  asset  acid  environmental  data.  Data  are  stored  in  the  HHR  as  trans¬ 
action  records  mini  they-  are  transferred  to  die  PP  for  analysis  and  storage.  The  HHR  can 
also  retrieve  stored  RP  rag  data  from  the  RCU  using  an  Ethernet  cable.  The  HHR.  uses  a 
Windows  Pocke:  Personal  Computer  operating  system,  which  is  a  commercial  off-the-shelf 
Technology'  (COTS)  software. 

Tne  RCU  ls  a  fried  RP  reader  that  collects  asset  and  environmental  data  from  die  RP  tags. 
Tne  RCU  is  pow  ered  by  24-  volts  direct  current  (VDC)  and  can  be  mounted  inside  a  munitions 
magazine  Depending  on  the  size  of  the  magazine,  RPEs  are  connected  in  series  with  the 
RCU"  to  achieve  optimal  RP  transmission  coverage.  The  RCU  obtains  data  from  the  RP  tap 
using  a  function  caked  interrogation,  which  consists  of  two  independent  reads  (short  and  long). 
The  short  read  determines  the  number  of  RF  rags  detected,  RP  tag  identification  (ID),  Depart- 
men:  of  Defense  Identification  Code  (DODIC).  National  Stock  Number  (NSW),  consignee, 
any  environmental  sensor  flags,  and  a  low  battery  flag.  The  time  duration  for  a  short  read 
depends  upon  the  number  of  RPEs  connected  in  series  with  the  RCU,  the  number  of  RP  tags 
detected  inside  the  storage  facility,  and  the  type  of  material  (wooden  crates  and  .aluminum 
pallets)  on  which  die  RP  tags  were  attached.  The  long  read  downloads  die  remaining  asset 
information  and  environmental  data.  The  duration  of  a  long  read  can  take  hours  to  days 
depending  on  the  number  of  RF  tags  being  interrogated.  The  RCU  serves  as  a  long-term  data 
storage  unit  for  receiving  and  storing  interrogated  RP  tag  data.  The  RCU  stores  these  data 
until  the  PP  commands  Lt  to  transfer  the  data  via  a  wireless  local  area  network  (WLAN),  local 
area  network  (LAN),  serial  c  able  c  onnection  with  the  PIHR.  The  RCU  has  no  direct  user 
interface  (i.e.,  no  keyboard  or  display). 

Tne  PP  is  an  interactive  command  and  control  system  designed  to  retrieve  RP  tag  data  from 
the  RCU  and  HHR.  The  PP  is  typically  located  in  the  central  work  area.  Munitions  informa¬ 
tion  is  formatted  and  passed  from  the  PP  to  service  ammunition  AISs  (e.g..  Retail  Ordnance 
Logistics  Management  System  for  US  Navy7  local  and  theater  inventory  management  of 
munitions)  and  the  EDB.  Munitions  experts  and  analysts  can  use  the  EDB  to  evaluate 
munitions  performance  fluctuations  due  to  environmental  changes. 

System  Concept 

Tne  ATOS  system  provides  two  key  capabilities  to  manage  the  DoD  munitions  inventory 
process:  environmental  surveillance  and  mmntLons  management.  To  perform  the  environmen¬ 
tal  surveillance  capability,  the  RP  tag  collects  and  records  temperature  and  RH  data  from 
tagged  munitions  pallets.  For  the  ACTD.  the  RP  tags  were  programmed  to  collect  and  record 
temperature  and  PFi  data  every  60  minutes.  The  G-shock  sensor  was  not  demonstrated  for 
dns  assessment.  The  environmental  data  collected  by  the  RP  tags  were  downloaded  to  the 
PP  via  RCU  or  HHR.  Table  1  describes  the  munitions  managemen:  tasks.  Figure  2  graphi¬ 
cally  displays  how  ATOS  automates  these  tasks,  and  Table  -  describes  the  ATOS  automation 
of  each  task. 
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Table  1.  Munitions  Management  Tasks:  These  six  tasks  form  the  foundation  for  hi  vent  coy  noiufiinnilf 
of  munitions. 


Munitions  Management  Tasks 

Name 

Ibsk 

Pdlei  Raoeipl 

Reoeh'einocmngmuniicfE  palate,  mave  tiam  loan  mid  storage  beaten ,  and  add  tiamlolhe 
invaitory. 

hvanbnf  Maritenance 

Mainlan  nverTtory  informal  on  on  minrlaispdl^i. 

Pdla  Mawentenl 

Move  mLnrians  pdiete  fran  onelocalcn  to  aiofter  wfiin  Ihe  samedepol. 

PdJel  Issue 

i  ssue  one  or  mere  ndrwdual  rnuiifcnstoTi  palate  to  load  Idd  unteand  update  rioerTtory 

Pdfel  Transfer 

Shp  muniiTis  pdlels  ton  one  depol  to  anotoar  and  ranow  rmndons  pdiate  ton  tie  engnaion  irr^antory. 

MurifwBQA 

Ramtcne  oieor  mere  induidua!  muniins  tom  pallate  fer  irEpeeion.Tmantenanoe  „  update  pallal  in’i«itory 
reton  irrfhtotHl  irmtaistotia  saTepdlal  afi^ir^ectoi.tttehterarEe,  and  update  tieinvaitoty. 

t>B  pot  2 


a 


•Location  •  Ti-srrfjr 
inwntory  data  co  RF  tag 
uoinqHHR.  Attach  Pf  sag  to 
mLnitionspsllaL 


Dtipul  1 


Invullary 
limr  regain  >idi  ftZU  I, include 
crMrormantal  historyi  or  roll 
call  *ithHHR 


'  j  'i  :  □  n  i  LtA:  F'jyfo 
individual  muni  dofe  for 
i  ns  p  a  ctio<V  maintenance  update 
paid  content  replace  in  pallet 
■and  roilcalUithl-HR  to  Ljodate 
pallor  oontrit- 


Piilel  Transfer 
Moll  call  with  HHR 
*  -id  r rare.- Nr  to 
mother  depot 


MuivlioiB  unit: 
Ramowindividinl 
munitions  and  roll 
cal  rtirhl-HR  ro 
Lpdate  pal  leicon  Sent 


PaHed  Wov&Tiont 
Hdl  call  with  HHR 
and  mo-t  to 
another  storage 
locadcri 


Fig  n  re  2.  _-3  u  non  fired  Munition  s  Management  Fu  notion  s:  A  TOS  is  -design  ed  it?  ciutom  a  fe  the 
current  labor-intensive  munitions  inventory  management  processes  by  supporting  six 
munitions  management  tasks. 
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I2z.bfe  J.  Munitions  Management  JaiArs  using  ATOS  System:  ATOS  system  automates  the 
currently  labor-intensive  munitions  management  processes. 


Munitions  Management  Processes  using  ATOS 

raanw 

Process 

Patel  tec  apt 

When  muttons  aiive  at  a  depot,  muttons  or  Ioffes  personnel  attadn  RF  lass  to 
muttons  pafets  and  palate  RF  lacs  wftn  asset  nfcrmaiton  for  each  muttons  psel  uang 
i»  H  HR .  Next  tagged  *1  „  -  [  0-3  0£  £3  3TB  3fd  t*  33:561  mfcfFHlTfl  E  Stored  CTl 

tie  HHR  as  a  transactor  record.  Tagged  muttons  pates  aie  moved  to  a  storage  loca^ 
'rfvere  live  RC  U  relieves  tie  asst:  rfetmafon  and  tie  latesternviormentsi  date  tom  tie 
muttons  patets.  Trie  RCU  updates  and  stares  tie  RF  teg  data  unit*  PP  commands  itto 
tansfer  tie  data  via  WLAN.  LAN  .or  live  HHR  serial  port  The  PPrecordes  t*  transactor 
records  tom  tie  HHR  and  RCU  date,  updates  tie  inventory  1st,  and  spaplfctty  inlays  tie 
date  or  tie  compiler  screen. 

Inventory 

Maintenance 

The  RCU  maintains  the  mutters  inventory  trough  periodic. ritaiogaltorps  of  tie  RF  tags,  tf 
te  RCU  encounters  a  new  or  missrci  RFteg.itsendsatagtotePP.  Whenoonductng 
inventory  tests  using  an  HHR,  tie  ATOS  operate  test  downloads  fne  inventory  1st  tom  tie 
PPtatveHHR.  Theoperatorthentefcestfve  HHR  to  the  magazine  TheHHRquertes  te  RF 
tegs  and  recencies  tie  inventory  is twiti  the  tagged  muttons  pafcte  inside  the  magazine. 

Any  new  or  missing  RF  tegs  are  lagged  by  tie  HHR  and  associated  date  are  later  transferred 
to  the  PP  The  operator  ties  afpopriate  actons  to  resdve  any  lags  fnatwere  sent  to  tie  PP 
tom  tie  HHR  or  RCU.  Tlvcu^ncuttlfs  process,  tie  RF  tegs  contenuatycotect  and  store 
envicnrrentel  dia. 

Palet  Movement 

Tagged  muttons  pafete  are  moved  ftom  one  tcafon  to  another  vitkin  te  same  depot.  The 
operior  uses  tie  HHR  to  update  tie  RF  tag  locator  itomaton.  On  the  neat  interrogator, 
te  RCU  automatcalv'  itodates  locator  date  on  tie  PP  inventory  fct 

Pafct  Issue 

The  operator  Esues  one  or  more  individual  rrutions  items  tan  tag^d  muttons  palets  to  a 
kcal  ftelduit  and  uses  te  HH  R  to  q>datete  muttons  cout  on  the  RF  tag.  The  RCU 
canities  te  mutters  count  chanoe  and  updates  te  PPtoventoryist 

PatetTransfer 

The  operator  sltps  a  tagged  muttons  palet  to  a  locator  oufcKte  of  the  depot  using  the  HH  R 

to  document  tie  transfer.  The  operator  uses  the  HHR  to  download  tie  latest  asset 
infcmiaton,  envicnmental  data,  and  any  alarm  tags.  The  HHR  is  docked  to  tie  PP  and  date 
aretansfened  tothePP.  The  R  F  teg  IDrunber  is  removed  Horn  the  inventory  1st  and  tie 
date  are  archived.  The  PP  autcmatcaly  updates  tie  inventory  records  of  te  tsrq  depot 
when  toe  HHR  is  docked  to  tie  PP  Muttons  pte£  are  not  tacked  wtie  in  tansit  between 
depot,  but  tie  R  F  tegs  wi  conthue  to  cotectenvicrmentel  date,  witch  is  tansferred  to  tie 

PP  at  tie  Aval  destenafon. 

Mutttons  QA 

The  operator  removes  one  or  more  iyfvidual  muttons  items  Iran  tagged  muttons  palets 
torltpectoninaitenanoe.  QA  personnel  use  he  HHR  to  iptete  tie"  palet  oorrfton  code 
and  Itstory  to  refect  tie  slates  of  tie  ivfvidLial  muttons  items  and  what  QA  ad  ora  wee 
taken  tponte  relun  to  t*  inventory  The  RCU  captores  tie  updated  infcimatton  and 
tarsfers  it  tothePP.  The  PP  tier  reoordes  tie  RCUand  HHR  data  and  ipdateste 
inventory  Bst  The  functor  was  not  sifported  dittng  the  ACTDstoioe  the  RF  teg  lacked 
sufftdentfietis  and  trading  capabity  to  record  inspector  and  maintenance  periled  on 
fKftrUid  muttons. 
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Assessment  Overview 


Objective  aad  subjective  data  were  collected  from  tbe  TECEVAL  md  three  opera:ional 
demonstration  event1:  between  March  2003  and  August  2004  to  asses1:  the  ATOS  system 
military  utility  in  providing  enviroismeatal  data  acid  automating  tbe  nnnrilicais  management 
tasks.  Table  5  describes  the  TECEVAL.  and  operational  demonstrations  used  co  assess  the 
ATOS  system 

Table  3.  MUA E-emeu tf  ration  Schedule:  S}sie?n performance  was  assessed  during  the  TECEFAL 
and  three  operational  demonstrations. 


Demonstration  Schedule 


Demons Eretinn  Date  location  Purpose 


TECE^L 

23  Wadn2EKH 

ISJJy  2CCM 

NAVSEA,  Indian  Head,  HD 

Damonstaie  syslam  performance  n  a 
oonboled  laboratory  anurcnmanl. 

QOQNUS  Derranstaton 

923  Harfi2Q CM 

Maau  Army  Hunitons 
Depot.  Mesu .  Gamany 

DamonSitaJe  syslam  performance  in  a  tieafer- 
Iwel  depot. 

CONUS  Damonstaton 

1 2-23  Apt  2fKH 

CAM,  Crane,  IN 

DamonSitaJe  svEtam  performance  in  a  stalegic- 
Iwel  depot. 

Wartime  Demonstaton 

G-9July2  DM 
Patl) 

Norfdk  Navd  Slaton 

(ooTibai  logistcs  dnp) 

Daman  stale  HHR  capdolity  toocndud  tie 
IcgEiitx  ta-EksvMfioul  hawing  Ihe  RCUinsldled 
ireide  a  shipboard  magazine. 

17-19AjjgLEl  2CKM 
Pat  2a) 

Norfdk  Navd  Staton 

(aroafl  earner} 

fie&eEA  RFlagruggedneES  on  rrunitons  pdlefe 
tanspoled  from  CMAto  Norbk  Naval  Staton . 

23-27rAugi^1  2HH 
(Pad  2b} 

Norfdk  Navd  Slaton 

faroafl  earner} 

Damcnstale  ivLlam  performance  in  a 
slnpboard  magazine. 

LUtsl-i  JaCwAwdri  Unta:  Sfcita  (OCflWUS) 
C-Tir-s-til  Lnt.:  aafcra  iTCOryuSj 


Limitations  and  Constraints 

While  a  thorough  assessment  of  the  ATOS  system  was  desirable,  it  was  constrained  by  two 
known  limitations  listed  in  Table  4  and  five  additional  limitations  listed  in  Table  5  encountered 
dining  the  demonsTahon  execution. 


Table  4.  Original  Limitations  and  Constraints:  Those  two  limitations  were  well  known  prior  to 
assessment  team  deployment. 


Original  Limitations  and  Constraints 

Inrrnarf 

Acfoji'necomiTiemdatffiin 

SsfiiOsArmiurildl  AJS  and  EDS 
liol  d  amend  ralsd. 

Lina  bis  to  assess  tis  inteiepsrdolity 
bslwsan  tis  PP  and  Sanies 
ArmunicnAIS  and  ED0. 

Con  dud  luHa1.  more  detailed  tsstng  during 
toftnal  aoquHfon. 

RF  lags  wane  placed  can  tis  culads 
olthe  mjritonspdld  containers. 

Una  bis  to  record  enworrheiiy 
readings  ol  Ihs  inads  ol  munHcns 
psllsl  oonlamaa  of  on  irtdiwdud 
munilons^lan  flay  w*rs  removed 
tom  Ihs  pdld. 

£d1adl  RFIagstourteid&dliiidwdual 
munilons  containers. 

Dsvslqpsmiranmsrrtal  sansofi  tial  are 
aTfcsdded  in  tw  muritons. 
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Table  5.  Additional  Limitations  and  C on s rra rn rs :  Five  additional  limitation!;  and  conziiai? if^ 
ii  ere  identified  during  the  demo  n strati  on  s . 


Additional  limitations  and  Constraints 

LiirirutfOri 

fr7ip™tr 

Acttaft'RihTCLrtiif  hWKLt  fltui 

RF  tegs  do  re>1  oded  daltflrite 
stomp  irtfffmalari. 

Undile-loGQfleiife  tef  rfseratere  and 
RH  maasranHA  to  a  spedld  trne. 

Used  T  ECEVAL  date  to  verily  sertettf  j&  j  jl-v. 
&jrivpdr«d  baselne  ternpierato'e  and  RH  wti 

RF  teg  histogram. 

N&OAperscnfietfivSlafcte  dJiflg 
operadiGdai  dfiflwislrafcns. 

Nu  ftWftWTwni  ._i  mi/iifcris  OA  task 
tody  f d  ATOS  specildaldisk 

Conducd  OAtesing  in  line  totfe. 

Norrtliiary  aidfll  demonslrflfcfl  and 
n&rentsvd  dTRFtegs  during 
nwllimfr  d&nortetalon . 

Lifrtted  asaessmefU  cd  ATOS 
coi^ponenl  ringed  ne  aa. 

Ooniidtortief  ruggedieea  tefrig  tietolu^ 

Lirrtied  vrstaily  into  RCU 
rifeffdgafcfl  pertfcaraanoe. 

tSfidjfl  to  verity  riu'rtwf  of  RF  lags 
delected  wlhin  tie  slated 
r&^twrrate  dl  1 45  and  21 5 
rnifRjtes. 

Used  tseTM-fitovfcled  data  Irorn  tie  RCU  date1 

error  logger  to  assess  RCU  Intem^altori  date. 

Nos  ME  assesariteril  of  ATOS 
nefcrtsrk  seajrily. 

Un^teloassessATOS  rteMdV 

Reqijasl  -.toird  kitorrrteloriOperatdriCenter 
oenduol  a  netorork  seotfly  sssessri  ieril  on 

ATOS. 

l&t  s  Jaoa  marcr  ccot*“ 

TM  tetTKJmjugQr 


Participating  Agencies 


US  European  Command 


Tlie  USEUCOM  is  a  unified  combatant  comm  and  v.liose  mission  is  to  main¬ 
tain  reach'  forces  to  conduct  the  Ml  spectrum  of  military  operation,  enhance 
transatlantic  security  through  support  to  She  North  Atlantic  Treaty  Organiza- 
nom  promote  regional  stability,  and  advanc  e  US  interest  in  Europe.  Africa, 
and  die  Middle  East.  As  :he  ACTD  sponscr.  toe  USEUCOM  provided  the 
Operational  Manager  (OM),  developed  operanonal  requirements  for  die 
employment  of  die  ATOS  program  technologies  developed  die  concept  of 
operations  (COKOPS).  and  supported  pians  for  the  demonstrations. 


Joint  Munitions  Command 


The  Join:  Munitions  Command  (JMC)  sen  es  as  ±e  Army's  single  manager 
for  producing.  s:onug.  maintaining,  and  demilitarizing  conventional  atrimmition 
for  ail  military  Seraces.  The  JMC  developed  the  Demonstration  Master  Plan, 
which  ardcuiated  the  ACTD  demonstration  strategy  used  :o  evaluate  the 
ATOS  system.  Additionally,  the  JMC  provided  the  Demonstration  Manager, 
assisted  USEUCOM  in  deveiopms  the  ATOS  system  CONOPS  and  support 
plans,  and  provided  operators  for  the  CONUS  demonstration. 


8  Advanced  Technology  Ordnance  Surveiilance  Finai  Report 

For  Official  Use  Only 


90 


Nava!  Sea  Systems  Command 


The  NAVSEA.  Naval  Surface  Warfare  Center  (NSWC),  Indian  Head  Divi¬ 
sion.  Serves  as  the  leading  research  and  development  organization  specializing 
in  developing  products  for  special  weapons,  explosives,  pyrotechnics,  and 
ordnance  handling  Its  primary  mission  is  to  transform  military  requirements 
into  naval  capabilities.  The  NAVSEA  was  responsible  for  the  program 
management  of  the  ATOS  ACID.  Dining  the  MUA.  ±e  NAVSEA  provided 
training  resources,  die  support  assc-ciared  with  the  developmem  and  demon¬ 
stration  of  ATOS  system  Technologies.  Technical  supporr  for  ACT'D  demon¬ 
strations.  and  the  ACT'D  TM.  NAVSEA  also-  provided  die  Transition  Man¬ 
ager.  who  is  responsible  for  transitioning  the  technology  to  the  warfighter. 


ga5H I 


US  Air  Forces  in  Europe 

The  mission  of  US  Ah  Forces  in  Europe  is  to  plan  conduct,  and  coordinate 
offensive  and  defensive  air  operations  in  the  European  area  of  responsibility 
(AOR).  The  US  Air  Forces  in  Eiarope  provided  operarors  for  the  OOGNU5 
demonstration. 


US  Army,  Europe 

Tiie  mission  of  US  Army  Europe  is  to  maintain  forward-deployed  comba: 
forces  trained  and  ready  to  conduct  and  suppon  joint  and  multinational  opera- 
dons  and  conduct  engagement  activities  to  protect  US  interests  in  die  Euro¬ 
pean  AGR.  The  US  Army  Europe  provided  operators  for  the  GCONUS 
demonstration. 


US  Atlantic  Fleet 


Tne  US  Atlantic  Fleet  provides  fully  trained,  combat  ready  forces  to  support 
US  and  North  Atlantic  Treaty  Orgamzanon  commanders  m  regions  of  conflict 
throughout  the  world.  From  (he  Adriatic  Sea  to  the  Arabian  Gulf.  Atlantic  Fleer 
units  respond  to  National  Command  Authority  tasking.  The  US  Atlantic  Fleet 
provided  operators  for  the  maritime  demonstrations. 


fh 


Det  1  AFOTEC 


Tne  Det  !  AFOTEC  mission  is  to  provide  independent  and  Tailored  demonstra¬ 
tion  and  utility  assessments  of  new  technologies  in  support  of  Combat  anr 
Commander  and  other  government  decision  makers  for  the  purpose  of  rapidly 
fielding  varfighting  capabilities.  Dining  this  ACTD.  De:  1  AFOTEC  was  the 
independent  assessment  agency  for  evaluating  she  military  utility  of  the  ATOS 
system.  De:  1  AFOTEC  reined  scenarios,  developed  the  MUA  assessment 
methodology,  and  wrote  this  final  MUA  report. 
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Execution 


Methodology 

The  imd-al  assessment  methodology  based  on  characterizing  the  military  utility  of  indi- 
vidual  ATOS  components.  Det  1 AFOTEC  developed  critical  operational  issues  (CGI), 
men  sines  of  effectiveness  (MGE).  and  measures  of  peifoimance  (MOP)  based  on  the 
requirements  stipulated  in  the  USEUCOM  Funcdonal  Requirements  Documen:  (FRD). 

Table  6  hsts  the  COIs  and  MOEs  from  the  approved  assessmen:  execution  document. 

Dunng  the  Miesau  demon&tradon.  USEUCOM  directed  Det  1  AFOTEC  to  assess  ATOS 
system  capabilities  in  support  of  environmental  surveillance  and  mumdons  managemen:.  The 
details  on  munitions  management  tasks  were  not  available  in  time  to  reuse  tne  COIs:  MOEs, 
and  MOPs.  Tnerefore.  the  assessment  team  correlated  existing  component-level  measures  to 
environmental  surveillance  and  mnnitions  management  capabilities.  As  a  result.  MOEs  12 
and  1.6  address  environmental  surveillance.  MOEs  2.5  through  2.E  characterize  the  ATOS 
system,  and  the  remainder  of  the  MOEs  address  munitions  management.  Appendix  B 
provides  the  correlation  of  the  MOEs  to  environmental  surveillance  and  individual  munitions 
management  tasks.  A  complete  list  of  MOP  results  is  contained  in  Appendix  D.  while 
Appendix  E  correlates  MOP  results  with  USEUCOM  FRD  requirements. 


Table  6.  COIs  and  MOEs:  Two  CGIs  -and  associated  MOEs  provided  a  framework  to  assess 
the  military  utility  qf  the  ATOS  system 


COIs  and  MOEs 

COfs 

MOEs 

1.  Does  ATOS  sup  pal 
asset  vi&bl  tty 
accounlab  lily,  and 
service*  l  fly  tor 
mu  nitons? 

f .  1  Capabltly  of  ATOS  system  lo  provde  ou  ntamer  location  data. 

1.2  Capabltly  of  ATOS  system  to  accurately  report  and  ma  rntam  flnvtam  mental 
data  on  containers. 

1.3  Capabltly  of  ATOS  RF  lags  lo  co  mmumcate  with  RCU  or  H  H  R. 

1.4  Capablity  of  ATOS  H  HR  and  RC  U  to  commun  tale  and  Ira  nsfer  data  lo  PR 

IS  Capabltly  of  ATOS  PP  lo  inter o  perale  with  Service  A  mmumlio  n  A  IS . 

1 .6  Capabltly  of  ATO  S  PP  lo  inter o  perale  with  E  DB. 

1.7  C  haracfertzaton  of  network  bandwidth  co  nneclivfly  to  ATOS  PP. 

1  .3  Capabltly  of  ATOS  system  lo  protect  data. 

1.9  Capablity  of  ATOS  ^slem  lo  provide  sufficient  data  storage. 

1. 10  C  haraclenzalion  of  ATOS  RC  U  ante  nna  coverage . 

1. 1 1  Capabltly  of  ATOS  RCU  lo  delect  RF  tags  at  initial  startup. 

1.12  Usablity  of  ATOS  HHR  in  fail  devices. 

1. 13  Capabltly  of  ATO  S  H  HR  lo  create  RF  tegs  a  nd  barcodes . 

2.  Is  ATOS 

supportable  for  mlitery 
operations? 

2. 1  Reliabltly  of  ATOS  RF  tag  atlachme  ft. 

2.2  Usablity  of  ATOS  H  H  R  a  nd  RCU. 

2.3  Usablity  of  ATOS  PP. 

2.4  Ease  of  confgualon  for  ATOS  component. 

2.5  Adequacy  of  ATOS  training. 

2.0  Adequacy  of  ATOS  cemponel  ruggedness. 

2.7  Sup  portebltly  of  ATOS  power  requ  retire  nls. 

2.3  Sup  porteblity  of  ATOS  instated  n. 

Data  Collection  and  Analysis 

The  assessment  team  collected  both  objective  and  subjective  data  dining  the  operational  demon¬ 
strations  using  the  scenarios  described  in  Appendix  C  Det  1  AFOTEC  used  Microsoft  Excel  to 
store  and  manage  data  collected  during  the  operational  demonstration  events. 


Advanced  Technoicgy  Ordnance  Surveittanoe  Final  Report  If 

For  Official  Use  Only 


93 


Objective  Data 

Objective  data  came  from  the  following  Semites: 

*  Assessment  team  observations  (initial  RP  tag  detection.  RP  tag  c  ommunkations  with 
HHR-RCU/PP) 

*  Kestrel  4000  portable  weather  scafron  data  {baseline  temperature  and  RH  data  during 
operational  demonstrations) 

*  ATOS  performance  data  (RCU  performance  logs,  environmental  histogram  data) 

*  Laboratory  insTumentation  atNSWC  during  the  TECEVAL  (baseline  temperature 
and  RH  data,  battery  test:  RCU  antenna  coverage,  noise  vibration  data) 

*  Extracts  from  RCU  data  (interrogation  time  cycle,  number  of  RF  tags  detected.  PP 
c  cmmunications  with  HHR.RCU: 

Subjective  Data 

Subjective  data  consisted  of  warfighter  and  SME  feedback  (documented  on  questionnaires) 
and  assessment  team  comments  (documented  on  observation  logs).  The  Det  1 AFOTEC  Test 
Director  observed  ATOS  training  and  the  lead  analyst  observed  the  ATOS  installation.  Roth 
"he  Test  Director  and  lead  analyst  observed  warfighters  during  operational  demonstration 
scenarios.  Questionnaires  were  tailored  and  administered  to  SMEs  based  on  their  area  of 
expertise  (operator,  munitions.  logistLcs.  or  security).  Appendix  F  provides  a  complete  listing 
of  questionnaire  results  from  all  operational  demonstrations  . 

ATOS  Events 


Tech  nica  I  Eva! naff o  n 

Toe  purpose  of  die  TECEVAL  was  to  c  ollect  performance  data  in  a  controlled  laboratory 
environment.  Tbe  TECEVAL  consisted  of  four  visits  to  tbe  NSWC.  Indian  Head.  MD  be¬ 
tween  US  March  2003  and  16  July  2004.  During  these  visits,  the  assessment  team  collected 
performance  data  on  the  RP  tag  environm ental  sensors,  antenna  coverage  range  data,  and 
changes  to  the  PP  software.  Two  end-to-end  system  tests  were  conducted  to  ensure  ATOS 
would  be  ready  to  support  the  OCONUS  demonstrations.  A  test  of  ATOS  autonomous 
operation  was  conducted  from  Id -16  July  2004. 

OCONUS  Demonstration 

The  purpose  of  the  OCONUS  demonstration  was  to  collect  performance  data  at  die  largest 
theater-level  munitions  storage  area  in  Europe.  The  OCONUS  operational  depot  demonsTa- 
tion  was  conducted  at  Miesau  Army  Ammunition  Dep  ot  at  Miesau.  Germany  from  9  to  23 
March  2004.  During  the  first  week,  the  assessment  team  observed  user  training,  as  well  as 
installation  of  the  ATOS  components  in  a  60  x  40  x  15  foot  earth- covered  magazine  and  a  70  x 
200  foot  open  storage  area  called  the  ammunition  Supply  point  (ASP)  (see  Figure  3).  After 
die  installation.  die  TM  placed  200  RF  tap  at  both  locations.  The  assessment  team  collected 
observation  data  and  administered  naming  questionnaires  during  the  first  week  of  the  demon- 
strati  cm  During  the  second  week,  the  warfighters  performed  die  scenarios  listed  in  Appendix 
C.  The  assessment  team  collected  observation  data;  administered  operator,  logistics,  and 
munitions  questionnaires:  and  collected  RCU  performance  data.  The  assessment  team  was 
not  able  to  collect  theater-level  QA  data  because  a  QA  participant  was  not  available  to 
support  the  demonstration. 
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Figure  3.  Miasm  Earth-Covered  Magazine  and  ASP:  The-  OCONUS 
demonstration  provided  two  distinct  em-iromnents  for  the  ATOS  system. 


CONUS  Demonstration 

The  purpose  of  the  CONUS  demonstration  was  to  collect  performance  data  at  a  strategic 
wholesale  depot  that  receives  and  simps  conventional  munitions  to  the  Army  and  Navy  world¬ 
wide.  The  CONUS  demonstration  was  conducted  at  two  test  sites  at  "he  CAAA  depot  at 
Crane..  IN  during  12  to  23  April  2004.  The  assessment  team  observed  user  training  as  well  as 
installation  of  he  ATOS  components  (six  RPEs.  RCU.  PR  md  WLAN)  in  a  100  x  50  x  IQ 
foot  earth-covered  magazine  (see  Figure  4).  This  demonstration  site  used  a  WLAN  repeater 
on  top  of  a  water  tower  to  establish  a  lme-of-sight  connection  to  the  PP.  which  was  approxi¬ 
mately  1.5  miles  away.  Tne  second  ATOS  test  site  was  a  200  x  50  foot  storage  warehouse 
(see  Figure  5).  Due  to  the  size  of  the 
storage  warehouse  and  he  large  amount  of 
conventional  munitions  stored  inside  his 
facility,  he  Tlvl  installed  1  2  PTEs  to  ensure 
maximum  RF  antenna  coverage.  The  TM 
installed  a  RCU.  PP  and  ULAN  inside  the 
storage  warehouse.  The  RCU  was 
hardwired  to  he  P?  via  Ethernet  connection. 

Only  200  FT  tags  were  used  in  the  demon¬ 
stration  based  on  he  approval  letters  re¬ 
ceived  from  he  Army  and  Navy  to  meet 
Hazards  of  Electromagnetic  Radiation  to 
Ordnance  (EERO)  requirements. 

The  assessment  -earn  collected  observation 
data  and  administered  training  questionnaires 
during  the  first  week  of  he  demonstration. 

During  the  second  week  of  the  demonstra¬ 
tion.  he  warfighters  performed  he  19 
scenarios  listed  m  Appendix  C.  The  assess¬ 
ment  team  collected  observation  data; 
administered  operator,  logistics,  munitions, 
and  Taining  questionnaires:  and  cohected  RCU  performance  data. 


Tej? ni re  4 .  CAAA  Earth- Covered  Magazine:  ATOS  was 
installed  in  this  earth- severed  magazine  in  Crane.  IX from 
12  la  23  April  2004. 
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Figure  5.  CAAA  S  forage 
Warehouse:  Twelve  RFZs 
ii  ere  required  to  provide 
complete  antenna  coverage 
in  a  large  storage  warehouse 


Ala  rifi m c  D&m  o  ?  istra  tion 

Tne  purpose  of  the  maritime  demonstration  was  to  collect  performance  data  mside  ship 
magazines.  The  maritime  demonstration  consisted  of  two  events  conducted  at  Norfolk  Naval 
Station.  The  first  assessment  event  was  conducted  on  the  USS  Ponce  from  6  :o  9  July  2004 
to  characterize  system  performance  on  a  combat  logistics  ship.  Since  the  magazine  was  very 
small  (10  k  22  x  S  feet),  an  RCU  was  not  installed  (Figure  6).  In  this  demonstration,  the 
HHR  was  used  :o  perform  toe  six  munitions  management  tasks.  During  this  demonstrati  on,  it 
was  learned  that  an  RCU  was  no:  required  to  perform  munitions  management  tasks  tf  a 
HHR  and  PP  were  available.  Tne  TM  staff  operated  the  PP  since  a  warfighter  was  not 
available  for  training  during  the  demonstration.  The  assessment  team  observed  training  and 
warffghter  performance  of  munitions  management  tasks.  At  the  end  of  the  first  maritime 
eiient.  the  assessment  team  administered  questionnaires. 


Figure  6.  Close -in  Weapons  Support  Storage  on  the  USS  Pome:  A  HHR  naz  used  io  detect  60  RF 
tags  placed  inside  the  storage  facility.  No  RCU  was  installed  inside  the  magazine. 
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The  second  maritime  assessment  event  was  conducted  17  to  27  August  aboard  die  USS 
Harry  S.  Inman.  Has  assessment  was  performed  in  two  parrs:  the  Srst  par:  characterized 
the  niggedaess.  reliability-  and  functionality  of  32  RF  tags  that  wen  attached  to  munitions 
pallets  arid  shipped  via  commercial  ground  transportation  from  CAAA  to  Norfolk,  VA:  the 
second  part  characterized  system  performance  on  an  aircraft  came:  {i.e..  a  combat  ship).. 
The  second  event  installed  the  ATOS  system  in  a  45  s  SO  x  10  foot  magazine  below  die  flight 
deck  hangar  (Tigni'e  7).  The  assessment  team  observed  traming  and  warfighter  perfor¬ 
mance  of  munitions  management  tasks.  At  die  end  of  the  second  maritime  event,  the  assess¬ 
ment  team  administered  questionnaires. 


Figure  Skip  Magazine  on  ike  USS  Harry  S.  Truman:  .i 
member  of  the  IN  ciqff  installed  wiring  far  the  RFEs. 
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Results 


Results  are  presenred  for  environmental  surveillance,  munition:  management  tasks.  and 
system  characterization.  Tin1:  will  facilitate  discussion  of  military  utility  conclusions  and 
recommendations.  As  stared  earlier.  MQEs  1.2  and  1 .6  support  environmental  surveillance, 
MQEs  2.5  through  2.8  characterize  the  ATOS  system,  and  the  remainder  of  the  MQEs 
support  munitions  management.  The  detailed  results  by  MQE  are  discussed  in  Appendix  D. 
Appendix  E  protide1]  the  correlation  of  FRD  requirement!  Co  the  MOP  remit: .  Appendix  F 
depicts  ±e  correlation  of  the  assessment  questionnaires  to  environmental  surveillance, 
muidtcns  management,  and  MOPs. 

Environmental  Surveillance 

Dara  gathered  during  the  TECEVAL  indioated  that  :he  temperature 
sensor  was  accurate  to  wit  bin  =  l3  Fahrenheit  (F)  of  the  environ- 
mental  chamber  settings.  and  chat  the  PH  was  accurate  to  within  = 

10%.  These  data  further  indicated  that  the  G-shock  sensor  was  not 
mature  enough  to  be  assessed  dining  the  demonstrations  because  of 
inadequate  electronic  coupling  between  the  G- shock  sensor  and  the 
RP  tag  board,  which  caused  false  shock  decections.  As  a  result,  the 
G-shock  sensor  was  not  assessed  during  the  demonstrations. 

For  two  days  during  the  GCONUS.  CONUS,  and  mar  Lime  demon¬ 
strations,  the  assessment  team  recorded  hourly  temperature  and  RH 
measures  using  a  Kestrel  400 G  weather  monitoring  station.  The  temperature  and  RH  mea¬ 
surements  were  compared  with  the  environmental  ltisto  gram  from  the  RF  tag  and  results 
indicated  tha:  temperature  and  RH  measures  correlated  with  data  captured  by  the  assessment 
team  The  RF  tags  collected  and  recorded  environmental  data  on  the  ragged  munitions  pallets 
every  GO  minutes  during  ah  deincnstraions. 

When  the  RF  tags  were  created:  the  environmental  sensors  began  collecting  hourly  tempera¬ 
ture  aid  RH  measures.  Most  of  these  RF  tags  had  more  than  4700  hours  of  conduuous 
operatLou  from  March  to  August  2004.  The  assessment  team  did  not  observe  any  failures  in 
the  temperature  and  RH  sensors.  The  TECEVAL  data  revealed  the  RF  tag  can  record  and 
store  environmental  data  for  45  days  (1DS0  data  points). 

During  the  demonstrations,  die  Tlvl  randomly  selected  die  upper  and  lower  user- selectable 
temperature  and  RH  limits.  Many  of  these  settings  were  not  operationally  representative,  but 
did  allow  assessment  of  limit  flag  reporting  (i.e..  when  temperature  reached  the  hunt,  a  flag 
was  set  and  data  were  reported  to  the  PR). 

The  warfighters  provided  comments  about  the  RF  tags'  environmental  sensors.  The 
warfighters  indicated  that  the  temperature  sensor  capability  would  provide  valuable  informa¬ 
tion.  A  Miesau  warfighter  stated  "Tne  temperaiurs  [user-selectable  limit]  war  easy  to 
change  and  will  be  especially  useful  when  the  temperature  range  requirements  for  critical 
munition:  are  defined  in  the  future. 

Aldiough  the  RF  tag  performed  w^ek  dining  die  demonstration,  some  of  the  warfighters 
expressed  concerns  about  die  cost  of  the  RF  tag.  since  they  were  not  designed  to  be  reusable. 
There  were  also  several  discussions  about  die  RF  tag  environmental  sensors.  One  warfighter 
stated  '"Tne  [RF]  tags  on  the  outside  of  container  don  t  accurately  give  temperature  and 
RH  inside  the  munitions  pallets."  Another  warfighter  wanted  to  know  immediately  when 
environmental  flags  were  tripped,  hi  addition,  one  SME  commented  that  it  would  be  useful  to 
know  exactly  when  an  environmental  flag  occurred,  and  requested  that  a  date  time  stamp  be 
added.  A  GAAA  warfighter  stated  that  the  RH  data  would  not  provide  useful  information. 
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race  to  see  tne  temperance 
sensor  incorporated  into  the  RF 
tag.  It  gave  an  indicator  if  there 
ii'(3r  a  problem  with  arnmuni- 
tions. " 
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Warfighters  mdicated  that  having  a  RF  tag  that  shows  when  a  munitions  pallet  was  dropped  is 
only  beneficial  if  the  RP  tag  can  accuracy  record  tbe  distance  dropped  or  shock  received. 
Finally,  as  stated  earlier  in  the  report,  the  G-shock  sensor  was  not  demonstrated  during  the 


MU  A . 


Munitions  Management 


Pa  Her  Receipt 


Pallet  receip:  consisted  of  receiving  incoming  ragged  munitions  pallets.  creating  and  attaching  the 
PF  trig  tc  he  munitions  pallets.  moving  the  tagged  munitions  pallets  to  an  initial  srorage  location  and 
adding  the  munitions  pallets  arid  their  content  to  she  inventory.  During  the  demonstrations,  the 
warfighters  were  able  to  create  new  RF  tags  usmg  the  HEP.  Ihe  warfighters  stated  'the  creation 
of  a  RF  :lt g  «  easy  and  strm^tfbnvardf  however,  the  assessment  team  observed  some 
problems  with  EHR  reading  asset  data  from  the  PF  tags.  It  may  require  the  warfighter  to  move 
die  HEP  to  diderent  angles  to  read  die  RF  tags.  Dining  the  demonstrations.  HHR  took  two  to  five 
minutes  to  read  and  write  to  a  RF  tag.  and  many  warfighters  complained  about  the  slow  processing 
speed. 

During  the  demonstrations,  the  warfighters  were  shown  two  me±ods  to  attach  the  RF  tags  to  die 
munitions  pallets.  Tne  first  attachment  method  used  wood  screws  and  the  second  attachment 
method  used  a  special  double-sided  adhesive  tape.  At  the  Miesau  and  CAAA  demonstrations .  the 
TM  used  coin  RF  tags  and  tag  holders  to  evaluate  adhesive  attachment  to  metal  and  w  ooden 
muniiions  panels.  Tag  holders  remained  attached  to  both  metal  and  wooden  munitions  pallets  during 
tbe  demonstrations,  hut  questionnaire  results  indicated  that  the  RF  tags  adhered  better  to  metal 
pallets  than  to  wooden  pallets.  Warfighters  were  concerned  that  the  tag  holder  would  fan  off  the 
wooden  pallets  and  recommended  securing  them  with  wood  screws. 


RF  tags  and  1 
holders  were 
placed  here 


During  die  maritime  demonstration,  the  CAAA  logistLcs  personnel  attached  32  RF  tags  to  the 
bottom  of  the  munitions  pallets  for  shipment  to  Norfolk  NavaS  Statiom  VAvia  commercial  ground 
tmnsportatLon  iFignt'e  S).  Thirty-two  RF  tags  were  placed  on  the  munitions  panels  ar  CAAA.  IN 
and  shipped  by  commencia]  ground  to  the  Norfolk  Naval  Station.  VA.  Because  Maty  munitions 
personnel  use  chains  to  cradle  the  panels  from  below  during  loading  of  the  munitions  pallets  onboard 
ship,  the  PF  tap  were  removed  torn  the  munitions  pallets  upon  arrival  to  avoid  damage  to  the  RF 

tags  dicing  loading.  Thirty-one  of  32  PF  tags 
*  were  removed  from  the  munitions  pallets  and 
were  undamaged  and  functional.  The  HER 
was  used  to  locate  the  missing  RF  tag;  which 
was  stiEl  attached  to  a  munitions  pallet  when  it 
was  moved  to  the  U5S  Harry  S.  Truman's 
magazine.  The  RF  tag  was  ftmctional  but  not 
visible.  The  assessment  team  was  not  able  to 
venfy  if  tbe  TM  staff  was  able  to  rente  ve  the 

misting  RF  tag 


Figure  5.  RF  Tag  Placement  During  Transport  r&  if re  USS 
Harry  S.  Truman:  Thirly-fty o  RF  jags  were  placed  on  the 
munitions  pallets;  at  CAAA,  iTv"  and  shipped  6i'  commercial 
ground  to  the  Norfolk  Naval  Station,  VA. 
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After  RF  tags  were  placed  on  die  munitions  pallets.  the  pallets,  were  moved  to  a  magazine  to 
he  interrogated  by  the  RCU.  The  RCU  and  RFE  were  effective  in  detecting  200  RF  tags 
inside  the  earth-covered  magazines,  storage  warehouse,  and  ship  magazine.  Ac  the  OCOKUS 
demonstration.  the  RCU  decected  199  out  of  200  RF  tags  (99.5%)  in  the  earth-covered 
magazine,  and  169  out  of  174  RF  tags  (97.1%)  in  the  ASP.  In  die  CONUS  demonstration  die 
RCU  detected  197  out  of  200  RF  tags  in  the  earth-covered  magazine.  In  both  demonstrations, 
the  firs:  interrogation  cycle  was  14  minuTes  on  the  short  read  and  two  hours  and  30  minutes  on 
the  long  read.  During  the  second  and  diird  interrogation  cycles,  ATOS  was  able  to  detect 
100%  of  the  RF  tags.  At  the  maritime  demonsTation.  the  RCU  was  able  to  detect  200  RF 
tags  on  the  USS  Harry  S.  Truman  on  the  first  interrogation  cycle.  Questionnaire  results 
indicated  the  RF  antenna  coverage  was  acceptable.  A  WLAN  or  LAN  was  used  m  transfer 
the  interrogated  RF  tag  data  (e.g..  missing  RF  tag.  environmental  flags,  and  updated  environ- 
mental  history  data)  from  the  R.CU  to  die  PR 

When  asset  information  was  loaded  on  die  RF  cag:  the  HHR  created 
and  storied  a  transaction  record  for  each  RF  tag.  The  transaction 
record  contains  the  asset  information  and  the  latest  update  in  the 
environmental  data.  During  the  CAAA  demonstration  the  assess¬ 
ment  ream  observed  that  when  the  warfighters  docked  die  HHR.  to 
the  PP.  some  transaction  records  did  not  ge:  transferred  to  the  PP 
and  other  transaction  records  were  deleted  from  the  HHR.  During  the  maritime  demonsTa¬ 
tion.  a  warfighter  attempted  to  oansfer  ISO  Tansaction  records  from  the  HHR  to  the  PP.  The 
HER.  software  timed  out  after  a  few  minutes  during  data  transfer  to  the  PR  The  IM  devel¬ 
oped  a  workaround  solution  to  demonsTate  the  pallet  receipt  capability  by  reducing  the 
number  of  transaction  records  (50  records  per  packet)  being  transmitted  from  the  HHR.  The 
assessment  team  also  observed  an  interoperability  issue  that  occurred  when  two  HHR:  were 
within  20  feet  of  each  other,  causing  the  HHR.:  to  look  up.  Despite  these  issues:  quesTomiare 
results  indicated  that  the  warfighters  believed  the  HHR  was  user  friendly  and  easy  to  use 
during  pallet  receipt  and  that  die  stylus  was  extremely  useful  in  data  entry  even  when  they 
were  wearing  bulky  work  gloves.  Questionnaire  responses  also  indioated  that  warfighters 
beheved  the  PP  was  easy  to  use  for  pallet  receipt. 

1  riven  lory  Ma in  ten  ance 

During  the  demonsTation:.  me  RCU  maintained  the  inventory  through  interrogations  of' the  ILF 
tags  every7  60  minutes.  Once  the  inventory-  list  reached  a  steady- state  condition,  the  R.CU"  only 
reported  exceptions  to  die  inventory.  If  the  RCU  encountered  any  emironmental  alarm  flags,  low 
batter/  power  flags,  or  missing  or  new  RF  tags,  a  warning  indicator  was  graphically  displayed  on 
the  PP  computer  screen.  These  warning  indicators  remained  on  the  computer  screen  until  the 
ATOS  operator  took  action  to  resolve  the  problem  or  cleared  the  warning  indicators. 

When  conducting  an  inventory  using  an  HHF_  warfighters  downloaded  the  inventory  list  to  the 
HHR  from  the  PP  and  performed  a  roll  call  function  (query-  each  RF  tag)  cm  the  HER.  The  HHR. 
compared  the  downloaded  inventory  list  to  die  F- F  tags  located  inside  the  magazine.  The 
warfighters  were  able  to  quickly  inventor.7  GO  RF  tags 
inside  the  USS  Ponce's  magazine  and  identify  new  or 
missing  tagged  munidons  pallets  using  the  HHR.  The 
assessment  team  compared  she  count  of  the  handwritten 
inventory  list  the  HHR.  Tansaction  records,  and  the  count 
on  the  PP  inventory.  .After  the  inventor/  was  completed, 
the  HHR  was  docked  to  die  PP  for  die  PP  to  receive  the 
updated  inventory  from  the  HHR. 


“[ATOS  mil]  induce  the  time  needed 
to  conduct  art  itrm&ary  of  a  60  x  40  x 
15  foot  earth-  covered  magazine  flom 
rrx  to  eight  hours  to  an  hour  or  less. J* 

Warfighter  c  ornment 


n[EF  tag  location]  is  mucfj 
bdurer  than  the  current 
method  used  now. JJ 

Warfighter  comment; 
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The  assessment  team  observed  that  the  RCU  cur recsfii  Sly  innn  i  -ored  i  fronting  and  outgoing 
tagged  munitions  pallets  during  the  Miesau  acid  CAAA  demonstrations .  The  warfighters  were 
able  do  locate  RP  tags,  verify  ±e  inventory  list.  and  identify  new  and  missing  RP  tags  inside 
die  magazine.  Assessment  team  observations  indicated  that  due  PPhad  sufficient  bandwidth, 
connectivity.  and  data  storage  to  perform  the  inventor/  maintenance  task.  Questionnaire 
results  indicated  that  the  warfighters  believed  that  the  RP  tags:  HHFL.  and  PP  were  easy  to 
configure  for  inventory'  maintenance. 

Dining  the  maritime  demonstration  the  PP  looked  up  when  downloading  the  inventory"  of  200 
RF  tags  to  the  HHR.  The  TM  identified  this  as  a  PP  software  problem,  hi  addition,  the 
assessment  team  observed  that  because  RCU  operation  could  no:  be  paused  during  tbs 
interrogation  cyrcle.  the  warfighters  were  unable  to  conduct  an  inventory-  until  die  interrogation 
cycle  was  finished. 


Dining  pallet  movement,  warfighters  used  the  HER.  to  update  the  location  field  on  the  RF  tag: 
and  the  RCU  updated  the  location  field  on  the  PP  inventory-  list.  Dining  the  pallet  movement 
demonstration,  no  RF  tags  were  physically  attached  to  the  munitions  pallets  stored  inside  die 
magazine.  The  assessment  team  selected  five  RF  tags  and  had  them  removed  from  an  eanh- 
covered  magazine  at  Miesau  and  CAAA  demonstrations.  Two  RF  tags  were  moved  to  a 
storage  warehouse  that  had  a  different  RCU.  The  other  three  RF  tags  were  placed  inside  a 
munitions  container  and  moved  away  from  the  magazine  to  simulate  munitions  pallets  in. 
transit.  The  RCU  detected  the  two  RF  tags  inside  the  storage  warehouse  as  existing  inventory 
and  updated  the  RF  tag  location  field,  and  the  warfighter  used  the  HER.  to  update  the  RF  tag 
information.  The  PP  identified  the  three  unssmg  RF  tags  by  ID  number.  When  the  three  RF 
tags  were  placed  back  inside  the  magazine,  the  missing  RF  tag  notifications  were  removed 
from  the  PP  display  dining  she  next  RCU  interrogation  cycle.  Dining  the  maritime  demonstra¬ 
tion.  the  assessment  team  removed  US  RF  tags  from  the  ship's  magazine  to  simulate  a  pallet 
movement.  The  PP  again  identified  the  nnssmg  RF  tags  by  ED  number.  When  10  RF  tags 
were  placed  back  into  the  magazme.  the  PP  identified  only  the  ten  remaining  missing  RF  tap. 
As  long  as  the  taggedmumtions  pallets  remained  with  die  assigued  RCU  ID.  they  could  be 
moved  anywhere  witlnn  the  magazine  without  the  PP  indicating  missing  RP  cags.  If  the 
tagged  munitions  pallets  were  removed  from  die  assigned  RCU  area  of  coverage,  the  PP 
notified  die  warfighters  within  G  O  minutes  of  the  last  RCU  interrogation  cycle  that  the  pallets 
had  been  moved.  If  the  tagged  munitions  pallets  were  moved  Co  a  different  building  with  a 
different  RCU  ID.  the  RCU  would  update  the  RF  tag  with  a  new  RCU  ED  number.  The 
assessment  seam  verified  the  location  changes  in  the  HHR  and  PP.  If  the  tagged  munitions 
pallet  w-as  moved  before  the  start  of  the  next  interrogation  cycle,  the  PP  does  not  receive  a 
fag  warning.  The  assessment  team  observed  tbrit  the  PP.  HER.,  and  RCU  had  sufficient 
bandwidth,  connectivity,  and  data  storage  to  perform  pallet  movement.  Questionnaire  results 
indicated  that  the  warfighters  believed  the  HHR.  and  PP  were  easy  to  configure  and  use  for 
pallet  movement. 


Pallet  Issue 

During  pallet  issue,  the  warfighters  simulated  the  issue  of  one  or  more  individual  munitions 
items  from  tagged  munitions  pallets,  using  the  HHR  to  update  the  munitions  count  on  the  RF 
tag.  The  HHR  was  later  docked  with  the  PP  and  the  inventory-  was  updated  to  reflect  the 
new-  munition:  count.  The  RCTJ  interropted  the  RF  tags  every  6Z  minutes  to  collect  any 
changes  in  due  asset  data.  Questionnaire  resp  onses  indicated  the  warfighters  thought  the 
HHR  was  easy  to  configure  and  use  to  update  the  munitions  comic.  The  assessment  team 
observed  that  the  HHR.  had  sufficient  data  storage  for  pallet  issue. 


Advanced  Technology  Ordnance  Surveillance  Final  Report 

For  Official  Use  Only 


102 


Pallet  Transfer 

During  pallet  transfer.  warfighters  prepared  the  tagged  munitions  pallets  for  shipment  outride  dae 
depot.  using  the  HHR  to  download  the  latent  asset  and  environment  data  and  any  environmental 
flag1].  Hue  warfighters  docked  the  HHR  to  transfer  die  data  to  the  PR  The  RF  tag  ID  number 
wafi  removed  from  the  inventory  and  the  data  archived-  Ihe  assessment  team  observed  die 
warfighters  download  the  asset  and  environmental  data  using  the  EHE_  The  assessment  team 
also  observed  warfighters  using  the  HHR  keypad  and  stylus  to  update  the  asset  data  and  transfer 
the  information  :o  the  PR  Tne  PR  HER.  and  RCU  had  sufficient  data  storage  for  pallet  transfer. 
Questionnaire  results  indicated  that  warfighters  believed  the  HHR.  to  be  instrumental  in  transfer¬ 
ring  tagged  munitions  pallets. 


Munitions  QA 

The  Munitions  QA  task  was  not  assessed  during  the  demcorstrations  (see  limitations  and  con¬ 
straints  secicn).  From  a  Quality  Assurance  Sped  a  h  st  Ammuuiti  on  Surveillance  specialist  view¬ 
point  the  current  design  does  not  haw  any  applicability  for  quality  control.  Questionnaire  re¬ 
sponses  indicated  the  RP  tag  does  not  have  any  fields  that  contain  information  about  the  inspection 
history,  recent  suspense  information.  or  condition  code  changes  mat  conld  impact  serviceability  of 
the  munitions  items. 

System  Characterization 


The  warfighters  indicated  the  training  was  effective  in  providing  die  necessary  information  to 
operate  the  AIDS  system  during  the  demonstrations.  The  raining  material  was  easy  so  understand 
and  the  system  was  easy  to  operate.  All  of  the  warfigh:ers  wanted  more 
hands-on  rime  with  the  system  during  the  classroom  instruction.  They 
also  would  like  to  have  had  a  training-user  manual  available  during  the 
classroom  inszncdon. 

Component  Ruggedness 

The  assessment  of  die  AIDS  component  ruggedoess  was  limited  Ihe 
TECEYAL  data  revealed  that  the  RF  tags  meet  the  ruggedness  requirements  stipulated  in  doe 
FRD.  Tne  assessment  team  collected  a  limited  amount  of  handling  data  during  shipment  from  the 
CAAA  to  Norfolk  Naval  Station.  AD  RT  tags  performed  nominally  during  the  demonstrations. 

The  assessment  ream  observed  two  inoperable  RF  tags  (one  RF  tag  from  the  Miesau  demonstra¬ 
tion  and  one  RF  tag  in  the  maritime  demonstration).  Due  Ed  is  currently  investigating  the  causes 
of  the  failures.  Ihe  assessment  team  did  not  observe  any  HHR  or  PP  failures.  The  assessment 
team  observed  two  RCU  failures.  The  first  failure  occurred  at  she  Miesau  demonstration  and  was 
caused  by  a  faulty  flash  memory  card.  Ihe  second  failure  occurred  at  the  maritime  demonstration 
and  was  caused  by  a  faulty  power  supply. 

Power  R&q uirem  enf 

No  RF  tags  were  replaced  during  the  demonstradons  due  to  low  battery'  power.  Question¬ 
naire  results  indicated  that  the  warfighters  would  prefer  to  be  able  to  replace  RF  tag  batteries 
rather  than  throwing  away  the  entire  RF  tag.  The  HHR  used  two  rechargeable  batteries  and 
docking  stations  to  ensure  power  was  maintained.  The  RCU  was  able  to  operate  as  long  as 
24  VDC  power  was  available.  During  all  demonstradons.  a  portable  gas  electric  generator. 
HLgh  Mobility  Multipurpose  Wheeled  Vehicle  battery  or  120/220  volts  alternating  current 
(VAC)  line  power  and  24  VDC  step  down  were  used  to  provide  electrical  power.  The 
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"For  myself  the  hands-on  framing 
was  how  I  really  began  to  under¬ 
stand  how  the  units  wurk. 
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warfighters  stated  that  tbe  PP  power  requirement!  were  straightforward  and  easy  to  accom¬ 
modate  a!  lone  a!  die  PP  was  hosted  in  a  facility  tba:  had  120-  220  VAC  electric  al  power. 


During  the  ATQ3  ACTD.  tbe  T\ls  staff  installed  tbe  RCTJ.  PFEs.  WLAN  or  LAN  inside  tbe 
magazines.  storage  warehouse.  ASP,  and  ^hip  magazines.  The  number  of  RFEs  required  to 
detect  200  RF  tags  was  determined  by  the  size  and  configuration  of  the  magazine.  Typically; 
die  installation  took  approximately  two  days  to  accomplish  at  each  demonstration  site.  On  die 
third  day.  die  TMs  staff  would  lay  out  200  RF  tags  and  conduct  several  experiments  to 
determine  the  optimum  position  for  tbe  RFE  s  to  detect  100%  of  RF  tags  mtide  the  magazine. 

Questionnaire  results  indicated  die  warfighters  believed  die  location  and  accessibility-  of  the 
RCL"  were  acceptable  for  the  demonstrations.  lie  wraps  were  used  to  install  the  RFFs:  while 
die  RC'Us  were  mounted  on  portable  stands.  The  PP  installation  was  straightforward  since  the 
software  was  pre-installed  on  a  laptop  computer. 

Security 

Toe  network  security  of  the  ATOS  system  was  not  assessed  due  to  the  unavailability  of 
information  security  SMEs. 
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Conclusions  and  Recommendations 


The  ATGS  system  demonsTated  potentm]  military  utility  and  was  effective  in  providing 
environmental  surveillance  and  enhimcingmuiutkius.  management.  Although  there  were  some 
technical  problems  encountered  during  die  demonstrations,  the  system  was  ab;e  to  provide  the 
warfighters  near  :eal-tLme  environmental  data  and  support  five  cut  of  the  six  liumitLons 
management  taste  during  the  demonstranoiis.  Table  7  identifies  the  environmental  surveil¬ 
lance  and  munitions  management  ratings  based  cn  the  assessment  team's  findings. 

Table  7.  MUA  Utility  Ratings:  The  system  iw:  effective  in  providing  the 
warfighter  wifA  environmental  surveillance  data  and  enhancing  inanitions 
management. 


ATOS  System  Capability 

Rating  I 

En\tironm  en  tal  Surveillance 

A 

Munitions  M  an  agement 

P:illri:  Ejccri.pt 

¥ 

[nvcntwy  Mj.intDia.ncc 

¥ 

Pfllh±  Movement 

A 

Pallet  Iraic 

A 

Pilld:  T  raimFcr 

A 

Munitions  Quality  Assur-moc 

System  Characterization 

Training. 

A 

Ri^dnca 

o 

Power 

A 

IxtstaUatum 

A 

Security 

cr> 

Legend 

Demoralraded  utKty;  cfeplDyafcte  now;  mirwimprave  mends  recommended. 

A  Polensal  utlrty;  minor  i  mprove  mends  recommanded . 

Potential  utlrty;  major  i  m  prove  mends  requ  rod. 

\/  No  uiilrty  da morffilrated ;  po sable  Jl idy ;  complete  redes gn  needed 

C  Insuff cent data  or  not  assessed. 

Environmental  Surveillance 

The  RP  tag  demonstrated  military  utility  and  was  effective  in  prodding  the  warfighters  a  new 
capability  for  collecting  environmental  data  on  tagged  munitions  pallets.  RP  tag  histogram 
data  correlated  closely  with  the  measurements  taken  by  the  assessment  team  during  the 
demonstrations.  The  warfighters  would  like  to  have  the  sensors  embedded  in  the  munitions  so 
that  accurate  environmental  readings  con  be  obtained  for  individual  items  and  for  conditions 
inside  the  pallet. 
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Munitions  Management 

The  consensus  of  the  warfighters  was  di^it  the  ATOS  system  demonsTated  military  utility  and 
enhanced  die  logistics  process  for  managing  munitions  pallets.  The  warfighters  were  im¬ 
pressed ’.vith  the  automated  capability  to  Tack  and  monitor  incoming  and  outgoing  ragged 
munitions  pallet  dining  pallet  movement.  pallet  issue,  and  pallet  transfer.  Listed  below  are 
die  conclusions  for  each  munitions  management  task. 

Pallet  Receipt 

The  ATOS  system  demonstrated  potential  military  utility,  but  will  require  major  improvement. 
The  system  was  effective  in  performing  palle:  receipt  of  20  to  60  RF  rags  and  reduced  die 
rime  to  receipt  incoming  munitions  pallets.  However,  die  technical  problems  encountered 
during  demcnsTations  make  the  system  performance  unacceptable.  Reading  and  writing  data 
to  and  from  the  RF  tag  using  the  HHR  was  rime  consuming,  there  were  daca  transfer  prob¬ 
lems  between  the  HHR  and  PR  and  an  interoperability  problem  occurred  when  two  HHRs 
were  within  20  feet  of  one  another.  Ibis  system  performance  was  unacceptable  to  tbe 
warfighter  since  a  depot  routinely  receives  large  numbers  of  incoming  munitions  pallets. 

Inventory  Maintenance 

Tne  ATOS  system  demonstrated  potential  military  utility,  but  will  require  major  improvement. 
Tbe  system  was  effective  in  performing  die  inventory  task  and  reduced  the  time  needed  to 
conduct  an  inventory.  L'The  HHR  and  RCL7  were  vs&fhl  in  tracking  ittcornuig  and  outgo¬ 
ing  tagged  munition:;  pallets  and  rrisnfi^  ing  alarms  ”  However,  the  PP  was  unable  to 
download  the  enure  inventory  of  200  RF  tap  without  locking  up.  This  function  must  be  fixed 
before  tbe  system  ls  deployed  to  tbe  warfighter. 

Pallet  Movement 

Tne  ATOS  system  demonstrated  potential  military  utility.  but  will  require  minor  improvement. 
Tne  system  was  effective  in  performing  pallet  movement,  with  she  warfighters  being  able  to 
use  the  HHR  to  update  the  location  field  on  die  RF  tag.  However  tbe  system  does  not  alert 
die  PP  with  a  flag  indicator  when  a  RF  tag  has  been  moved  to  a  different  building  and  interro¬ 
gated  by  a  different  R.CU.  A  warning  indicator  should  be  incorporated  in  the  PP  software 
which  will  identify  any  tagged  munition  pallets  that  were  moved  before  the  next  interrogation 
cycle.  OdierwLse:  the  PP  was  able  to  verify  that  tagged  munitions  pallets  had  been  moved 
from  one  location  to  another  within  the  same  depot. 

Pallet  Issue 

Tne  ATOS  system  demonstrated  military  utility  and  was  effecdve  in  performing  pallet  issue, 
with  warfighters  being  able  to  use  tbe  HHR  to  update  tbe  munitions  count  on  the  RF  tag  and 
the  RCU  successfully  capturing  the  munitions  count  changes  and  reconciling  diem  with  the 
inventory  on  the  PP. 


Pallet  Transfer 

Tne  ATOS  system  demonstrated  military  utility  and  was  effective  in  performing  "die  pallet 
Transfer.  The  warfighters  were  able  to  downlead  asset  and  environmental  data  from  the  RF 
tap  using  die  HHR  and  transfer  the  data  to  the  PP  where  tbe  RF  tag  ID  was  removed  from 
the  inventory'  and  tbe  data  archived. 
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OA 

The  Munitions  QA  cask  was  no:  assessed  by  die  assessment  team  during  the  demonstrations. 


System  Characterization 


Training 

The  overall  feedback  the  assessment  team  received  from  the  warfighter  was  that  the  ATOS 
system  naming  was  adequace  and  provided  die  necessary'  information  to  operate  the  system. 
The  warfighter  indicated  the  -raining  was  effective  in  providing  the  necessary' information  to 
operate  the  ATOS  system  during  the  demonstrations. 

Component  Rugged  ness 

The  AIOS  system  component  performed  nominally  dining  die  demonstration.  The  assess¬ 
ment  team  did  not  observe  any  major  failures  that  the  TM  could  no:  recover  in  a  couple  of 
hours.  ATOS  performed  most  of  the  mumdons  tasks  with  nc  major  issues. 

Power  Req  u  irem ent 

No  major  issues  were  idendfied  at  the  demonstration  sites  in  providing  the  necessary7  power  to 
support  ATOS.  The  warfighters  wanted  a  capability  to  replace  die  batteries  in  the  RF  tag. 

Fnsta  Untiari 

ATOS  ccmponen:  installadcn  was  straightforward  and  easy.  No  majcr  issues  were  identified 
at  the  demonstrations. 


Security 

Security  was  not  assessed  by  the  assessment  :eam  during  die  demonsTations. 


Recommendations 

Recommendations  are  based  on  warfighter  inputs  and  the  results  from  the  ATOS  MUA. 
These  recommendations  were  separated  into  two  categories:  11  recommendations  for  system 
improvements  and  two  recommendations  for  further  resting. 

Envi  ronm  en  ia  1  Surveillance 

-  Provide  time  and  date  stamp  association  to  determine  when  a  critical  munitions  Ltem 
experienced  extreme  temperature  and  RH  variations. 

*  Develop  reusable  RF  tags 

*  Develop  and  demonstrate  a  G-shock  sensor  capability 

*  Attach  RP  tags  to  iusLde  of  individual  munitions  containers 

*  Develop  environmental  sensors  that  are  embedded  in  the  munitions 
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Man i ti ons  Managem ent 

Reduce  EHR  read  and  write  processing  speed  if  mi  5  mmutes  so  40  seconds  or  less 

Fix  die  data  transfer  problem  with  the  HHR  so  shat  it  is  able  to  transfer  the  designed 
number  of  transaction  records  (approximately  FtKKl)  to  the  PP 

Develop  procedures  or  software  modifications  allowing  die  use  of  HEP.s  in  close 
proximity  of  each  other 

Develop  a  pause  funcsicn  on  the  RCU  to  allow  the  warfighters  to  perform  logistical 
tasks  using  the  HHR 

Fix  die  PP  data  transfer  problem  so  that  the  HER  can  download  the  ensile  inventory 
hst  to  the  EHR 

Modify  die  RJ  tag  so  that  munitions  QA  can  document  condition  codes  and  inspection 
history 


Test  Refinement 

Evaluate  die  interoperability  of  die  Service  Ammunition  AI5  and  EDB  with  AIDS 
Evaluate  network  security  of  the  ATOS  system 
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ACTD 

adduced  coucep:  technology  demonstration 

AFOTEC 

Air  Force  Operational  Test  and  Evaluation  Center 

AIS 

automated  information  system 

AIT 

automatic  identification  technologies 

AOR 

area  of  responsibility 

ASF 

ammunition  supplypoint 

ATOS 

Advanced  Technology  Ordnance  Surveillance 

CAAA 

Crane  Army  Ammunition  Activity 

COI 

critical  operational  issues 

CONORS 

concept  of  operations 

CONUS 

continental  United  States 

COIS 

commercial  off-rke-skelf 

De:  1 

Detachment  1 

DoD 

Department  of  Defense 

DODIC 

DoD  Identification  Code 

EBB 

environmental  database 

F 

fahrenkeit 

FRD 

functional  requirement  document 

G-shock 

gravity-shock 

HERD 

Hazards  of  Electromagnetic  Radiation  to  Ordnance 

HHR 

handheld  reader 

ED 

identification 

JMC 

Joint  Munitions  Command 

LAN 

local  area  network 

LCD 

liquid  crystal  display 

MB 

megabytes 

MEMS 

micro-electromechanical  systems 

MHz 

MegaHertz 

MOE 

measures  of  effectiveness 

MOP 

measure  of  performance 

MUA 

military  utility  assessment 

rnW 

miCr.vatr 

KAVSEA 

Naval  Sea  Systems  Command 

NSN 

National  Stock  Number 

NSWC 

Naval  Surface  Warfare  Center 

OCGNUS 

outside  the  continental  United  States 

OM 

Operational  Manager 

PP 

preprocessor 

QA 

Quality  Assurance 
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RCU 

reader  control  nnit 

RP 

radio  frequency' 

RFE 

radio  frequency  extenders 

RH 

relative:  humidity 

SME 

subject  matter  expert 

TECEVA1 

technical  evaluatioo 

TM 

technical  manager 

USEUCOM 

US  European  Command 

USS 

United  States  Ship 

VAC 

volts  alternating  current 

VDC 

volts  direct  current 

WLAN 

wireless  local  area  network 
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B 


Correlation  of 
Environmental  Surveillance 
.and  Munitions  Management 
to  Measures  of  Effectiveness 
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Table  B-l  correlates  MOE 3  addressed  during  the  MUA  with  enviiannoieiiial  surveillance  and  munition-]  manage¬ 
ment  tasks. 


Table  B-l.  Correlation  o/MOEs  to  Environmental  Surveillance  and  Munitions  Management  Tasks: 
The  MOEs  were  correlated  to  the  environmental  surveillance  and  munitions  management  tasks  to 
illustrate  the  assessment  methodology  . 


Correlation  of  Munitions  Mamgemetyt  and  Environmental  Surveillance  to  MOEs 

Munitions  Management 

MOE 

$ 

# 

if 

// 

& 

/ 

COI  1.  Does  AIDS  support  asset  viability,  accountably,  and  serviceability  for  munitions? 

1 .1  Capablily  of  ATOS  system  to  provide 
conte  iner  location  date 

• 

4 

4 

■» 

■ 

1 2  Ca  pab  lily  of  ATOS  syste  m  to  accurately 
re  port  and  maintain  environmental  data  on 
containers 

• 

1 6  Ca  pab  lily  of  ATOS  RF  tegs  to 
communicate  with  RCU  or  HHR 

• 

4 

4 

4 

* 

4 

1.4  Capably  of  ATOS  HHRand  RCU  to 
communicate  and  transfer  date  to  PP 

■ 

4 

• 

* 

4 

4 

1.5  Capably  of  ATOS  PPto  interoperate 
with  Service  Ammunition  AIS 

1.6  Capably  of  ATOS  PPto  interoperate 
with  EDB 

1 .7  Characterization  of  network  bandwidth 
conneclivy  to  ATOS  PP 

■ 

■ 

4 

4 

4 

• 

16  Capably  of  ATOS  systemic  protect  date 

■ 

■ 

4 

* 

* 

4 

1 .9  Ca  pab  iy  of  ATOS  syste  m  to  prov  ide 
sufficient  data  storage 

■ 

■ 

4 

* 

• 

• 

1 .10  Characterization  of  ATOS  RCU  antenna 
■coverage 

• 

4 

4 

4 

4 

1 .11  Capabiity  of  ATOS  RCU  to  detect  RF 

tags  at  initial  startup 

# 

4 

1.12  Usably  of  ATOS  H  HR  input  devices 

■ 

■ 

4 

4 

* 

* 

1 .1 3  Capably  of  ATOS  H  H  R  to  create  RF 
tags  and  barcodes 

• 

COI  2.  la  ATOS  supportable  tor  mlrtary  operations? 

2.1  Reliabiltyof  ATOS  RF  teg  attachment 

m 

■ 

4 

4 

• 

* 

22  Usably  of  ATOS  HHRand  RCU 

4 

4 

• 

* 

4 

• 

2.3  Usably  of  ATOS  PP 

4 

* 

• 

* 

• 

• 

2 .4  Ease  of  co  nf  iguralion  for  ATOS 
components 

i 

■ 

4 

* 

• 

• 

2  5  Adequacy  of  ATOS  train  ing 

* 

4 

* 

4 

4 

4 

2 .6  Adequacy  of  ATOS  compone  nt 
ruggedness 

■ 

■ 

4 

• 

• 

• 

2 .7  Supportab By  Of  ATOS  power 
requirements 

4 

• 

• 

4 

4 

4 

26  Supportably  of  ATOS  installation 

* 

4 

4 

• 

• 

4 
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Detailed  Scenarios 


Advanced  Technology  Ordnance  Surveillance  Final  Report  C-i 

For  Official  Use  Oniy 


117 


This  page  iniertrionally  left  blank. 


C-2  Advanced  Technology  Ordnance  Surveillance  Final  Report 

For  Official  Use  Only 


118 


Table  C-l  describes,  the  19  scenarios  that  were  used  to  demonstrate  environmental  sinveiLance  and  mnnitioLis 
nnuiagemea:  capabilities.  Each  scenario  was  repeated  at  least  five  times  by  the  participants  to  ensure  they 
completely  understood  the  ATOS  system  operations. 

Table  C-l.  MUA  Scenario:  Nineteen  scenarios  were  conducted  to  ensure  all  ATOS  functions  were 
assessed. 


ATOS  Scenario 

Scenario  Script 

Description 

1 .  Demonstrate  capablily  lo  conduct  the 
administrator  fo notions  of  tlw  PP  and  HHR. 

Operators  perform  administrative  and  setup  functions  with  HHR 
prior  lo  start  of  the  demonstration,  which  includes  docking  the  HHR 
to  the  PP  and  configuring  the  PP  and  the  RCU. 

2.  Demonstrate  PP  operate r&imeonju notion 

with  the  HHR  and  RCU  operations. 

Operators  conduct  munitions  management  tasks  using  the  HHR, 

RCU,  and  PP. 

3.  Demonstrate  how  to  set  the  sensor  alarm 
thresholds. 

Operators  set  RF  lag  sensor  alar  m Ihres holds  during  initial  craalio n 
of  RF  tags;  thresholds  for  some  RF  tegs  are  set  above  or  below 
ambient  temperateres  lo  triqqer  alarms. 

4 .  Create  new  RF  tags,  with  the  H  H  R  {using 
keypad). 

Operators  create  25  RF  tags  using  the  HHR  keypad  lo  enter  asset 
information. 

£ .  Create  raw  RF  tags  using  data  from  the 
PP. 

Operators  create  five  RF  tags  usi  ng  asset  informalio  n  tom  the  PP 
{downloaded  from  the  PP  lo  the  HHR  and  transferred  to  RF  teg). 

6 .  Create  new  RF  lags  using  data  from  bar 
code  labels. 

Operators  create  five  RF  tags  usi  ng  date  from  bar  code  labels . 

7.  Perform  inner-area  of  movement  tagged 
munitions  pa  lets. 

Operators  move  RF  tegs  fro m ora  location  lo  another  within  the 
muni  Sons  fad  My. 

3.  Move  tagged  munitions  palel  with  a  bad 
RF  lag  (not responding  due  to  dead 
battery). 

Operators  move  bad  RF  tags  from  one  location  to  another  wrlhi  n  the 
munilionsfaclrty'  and  replace  bad  RF  tegs  with  f  Jy  functional  items. 

3.  Move  tagged  munitions  palel  with  a  bad 
RF  tag  {reason  other  than  dead  battery). 

Operators  move  bad  RF  tags  from  one  location  to  another  within  the 
munitions  facifty,  simulate  dead  RF  teg,  and  simulated  bad  RF  tag 
with  fully  functional  tern. 

10.  Movement  of  asset  with  a  tripped  sensor 
alarm. 

Operators  perform  inventory  actio  ns  fo  address  tripped  sensor 
alarms. 

11.  Move  me  nt  of  tagged  munitions  palel 
with  low  battery. 

Operators  move  an  RF  tag  with  low  battery  from  ora  location  to 
another  within  the  munitions  faciily  and  replace  the  RF  teg  with  ora 
that  has  a  foly  functional  battery. 

12.  Change  RF  tag  data. 

Operators  edit  asset  information  on  RF  tegs  using  the  HHR,  read 
the  edited  information  using  the  RCU.  and  update  the  P Fusing  the 

H  H  R  via  docki  ng  stetio  n. 

13.  Asset  receipt 

Operators  perform  asset  transactions,  such  as  palel  receipt. 

14.  Asset  issue  {entire  palel  with  RFlag). 

Operators  use  the  H  H  R  lo  issue  co  mends  of  an  e  mire  tagged 
munitions  palel 

15.  Asset  issue  {partial  palel  -  RF  teg 
remains). 

Operators  use  the  H  H  R  lo  issue  so  me  of  the  conte  ms  from  a  lagged 
munitions  palel  noting  the  quantity  and  type  of  items  issued. 

16.  Asset  Ira nsfer  {shipment). 

Operators  transfer  tagged  munitions  palm  torn  ora  location  to 
another  and  validate  transaction  {i.e.,  determine  if  asset  data 
elements  in  the  PP  match  those  that  were  transferred). 

1 7.  Perform  inventory  of  al  tagged  munitions 
palels  in  a  storage  location. 

Operators  use  the  HHR  rd  cal  fundio n  lo  conduct  munitions 
inventory. 

1 6.  Search  for  a  nd  identity  various  RF  tag 
using  HHRfindfonction. 

Operators  use  the  HHR  rd  cal  function  to  find  tagged  munitions 
pallets 

19.  Download  RCU  fles. 

Operators  use  the  H  H  R  to  download  interrogation  fles  from  the 

RCU. 
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Performince  Results 
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Ibis,  appendix  present1]  the  detailed  results  for  the  MOEs  and  VO  Pi  used  to  derive  the  results  and  conclusions 
for  riie  ATOS  MUA.  The  bar  charts  show  aggregated  responses  from  operators,  logistic  %  mdmuniions  partici¬ 
pants.  The  analysis  revealed  no  significant  differences  in  warfighters"  opinions  at  the  demonstrations. 

MOE  1.1  Capability  of  ATOS  system  to  provide  container  location 
data _ 

This  MOE  assesses  the  ATOS  capability  to  provide  and  update  location  data  (budding  grid  coordinate)  on  tagged 
munitions  pallets.  During  the  demonstrations.  the  RT  tag  was  able  to  maintain  location  held  data  and  gave  tlie 
warfighter  a  capability  to  update  FT  tag  loc  ation  information. 

MOP  1.1.1  Capability  of  ATOS  system  to  provide  container  location  data 

The  HHR  was  used  by  the  warfighters  to  input  budding  coordination  grids  in:o  the  FT  tag  location  data  field  and 
the  R.CU  --hen  updated  fhe  RCU  location  field  on  the  PP.  At  each  demonstration  sire,  the  warfighters  were  tasted 
to  change  the  location  held  on  20  FT  tags.  The  assessment  team  verified  the  location  changes  in  the  EHP.  and 
PP.  As  long  as  the  tagged  munitions  pallets  remained  within  the  assigned  RCU  ED.  fhe  raggedmumrions  pallets 
couid  be  moved  anywhere  in,  the  magazine  and  the  PP  would  no:  hag  a  missing  FT  tag.  If  the  tagged  munitions 
pallets  were  moved  to  a  different  building  with  a  different  RCU  ED  before  the  60-mmute  interrogation  cycle.  ±e 
new  RCU  would  update  the  RT  tag  with  a  new  RCU  I D  number  The  warfighter  would  no:  be  notified  when 
tagged  munitions  pallets  were  moved  to  a  different  location  since  die  PP  would  reconcile  the  inventor/  and  show 
the  tagged  munitions  pallets  were  picked  up  by  another  RCU.  Therefore,  the  warfighter  would  not  know  die 
location  of  a  moved  raggedmmndon  pallet  without  referring  to  the  PP.  One  warfighter  stated  the  RT  tag  location 
capability  is  "Mitch  easier  than  the  current  method  used  now  '' 

MOP  11.2  Operator  assessment  of  RF  tag  location  capability 

The  questionnaire  responses  indicated  the  RT  tag  location  capability  was  acceptable  in  supporting  the  warfighter 
m  locating  tagged  munitions  pallets  (Figure  D-l).  The  warfighters  believed  the  RF  tag  loc  ation  capabihty  made 
their  job  of  locating  tagged  munitions  pallets  easier  A  CAAA  warfighter  stated.  :iT}\e  accuracy  of  the  location 
reports  would  be  useful.  Howe\  ert  need  to  see  ATOS  work  in  a  jam  jrcm  {mimirions  pallet:  stacked  end-to- 
end}  environment. IJ 


Figure  1^-1.  Questionnaire  Remits,  RF  Tag  Location  Capability:  30  of  31  warfighter:  agreed 
that  the  RF  tog  location  capability  nos  acceptable. 
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MGE  1.2  Capability  of  ATOS  system  to  accurately  report  and 
maintain  environmental  data  on  containers _ 

This  MGE  assesses  RP  tag  capability  to  accurately  measure  Temperature.  RP1  and  G-skock;  and  to  alert  the 
operator  if  an  environmental  condition  exceeds  die  threshold  of  die  munitions.  Although  die  RP  tags  collected 
environmental  data,  tire  assessment  team  received  a  few  negative  comments.  One  CAAA  warfighter  felt  the 
RH  daca  would  not  provide  usefiil  information.  Smother  warfighter  stated.  'Tags  on  rhe  outside  of  con  tamer 
does  nor  [sic]  accurately  give  temperature  and  RH  inside  the  munitions  pallets™ 

MOP  1.2.1  Percentage  of  ATOS  RF  tags  that  accurately  report  and  maintain 
environmental  data  of  the  containers 

During  TECEVAL,  20  RP  tags  were  placed  inside  an  em.ironmental  chamber  to  determine  if  die  RP  tags  accu¬ 
rately  recorded  the  Temperature  and  RH.  Ihe  histogram  data  revealed  all  20  RP  tags  (100%)  accurately  re¬ 
corded  die  temperature  and  RH  data.  During  the  demonstrations,  the  RP  tag  histogram  data  correlated  with  the 
temperature  and  RH  data  collecTed  by  die  assessment  team. 

MOP  1.2.2  RF  tag  temperature  accuracy 

The  TECEVAL  data  indicated  the  temperature  sensors  on  the  20  RP  tags  were  accurate  within  ±  IT  readings 
from  the  emironmental  chamber  settings.  Ihe  assessment  team  was  unable  to  measure  temperature  accuracy 
during  the  demonstrations  because  the  mediod  on  how  the  RP  tag  collects  Temperature  data  was  changed  to 
develop  the  histogram  data.  Therefore,  the  data  was  unavailable  to  the  assessmenr  team. 

MOP  1.2.3  Reliability  of  RF  tag  temperature  sensor 

When  the  RP  tags  were  initialized,  they  continued  to  collect  hourly  temperature  measures.  Most  of  the  histogram 
information  RP  tags  had  more  than  4.700  hours  of  continuous  operation.  The  assessment  team  did  nor  observe 
any  failures  in  the  Temperature  sensor. 

MOP  1.2.4  RF  tag  relative  humidity  accuracy 

The  TECEVAL  data  indicated  the  RH  was  accurate  within  ±  10%  of  die  environmental  chamber  settings. 
TECEVAL  data  also  indicated  that  the  RH  sensor  would  give  erroneous  readings  if  the  RH  was  above  95%  or 
below  10%.  The  assessment  team  was  unable  to  measure  RH  accuracy  during  die  demonstration  because  the 
method  on  how  the  RP  tag  collect  RH  data  was  changed  to  develop  histo  gram  data. 

MOP  1.2.5  Reliability  of  RF  tag  relative  humidity  sensor 

When  the  RP  tags  were  midalized:  they  continued  to  collect  hourly  RH  measures.  Most  of  the  RP  tags  were 
initialized  m  March  2004  (more  than  4  JOO  hours).  The  assessment  team  did  not  observe  any  failures  in  the  RH 
sensor. 

MOP  1.2.6  RF  Tag  gravity  -shock  accuracy 

Not  assessed.  The  G-sbock  sensor  was  not  available  to  support  the  demonstrations. 

MOP  1.2.  7  Reliability  of  RF  tag  gravity-shock  sensor 

Not  assessed.  The  G-shock  sensor  was  not  available  to  support  the  demonstrations. 

MOP  1.2.  8  Number  of  days  RF  tag  accurately  records  and  stores 
environmental  data 

Not  assessed  The  TECEVAL  data  revealed  the  RF  tag  could  record  and  store  45  days  {10S0  data  points)  of 
environmental  data.  Since  RP  tags  were  cleared  for  each  demonstration,  the  assessment  team  was  not  able  to 
assess  maximum  number  of  days  the  RP  tag  could  accurately  record  and  store  environmental  data.  The  assess¬ 
ment  team  observed  no  problems  with  the  RP  tags  holding  all  the  environmental  data  during  the  demonstration. 
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MOP  1.2.9  Frequency  of  temperature  reports  stored  in  RF  tag 

The  RF  tag  was  designed  to  collect  temperature  reports  every  60  minutes  when  initialized.  The  results  mdLcated 
the  RT  tag  collected  and  recorded  temperature  data  every  60  minutes. 

MOP  1.2.10  Frequency  of  relative  humidity  reports  stored  in  RF  tag 

The  RP  tag  was  designed  to  collect  RH  reports  every’  6Z  minutes  when  initialized.  The  results  mdicated  the  RP 
tag  collected  and  recorded  RH  data  every'  60  minutes. 

MOP  1.2.11  Number  of  temperature  reports  above  a  user-selectable  limit 

TECEVAL  data  showed  20  RF  tags  had  sheir  upper  temperature  limits  set.  All  20  RF  tags  had  their  environment 
flags  nipped  at  tbe  appropriate  temperature  settings. 

MOP  1.2.12  Number  of  temperature  reports  below  a  user-selectable  limit 

TECEVAL  data  showed  20  RP  tags  had  their  lower  temperature  limits  set.  All  20  RP  rags  bad  their  environment 
flags  tripped  at  tbe  appropriate  temperature  settings. 

MOP  1.2.13  Number  of  relative  humidity  ?reports  above  a  user- selectable 
limit 

TECEVAL  data  showed  20  RF  rags  bad  their  upper  RH  limits  set.  All  20  RP  tags  had  tbeir  environment  flags 
tripped  at  the  appropriate  RH  settings. 

MOP  1.2.14  Number  of  relative  humidity  reports  below  a  user- selectable 
limit 

TECEVAL  data  showed  20  RF  rags  bad  their  lower  RH  limits  set.  All  20  RP  tags  had  tbeir  emironment  flags 
tripped  at  the  appropriate  RH  settings. 

MOP  1.2.15  Number  of  gravity-shock  sensor  reports  above  the  first  limit  on 
the  x-axis 
Not  assessed 

MOP  1.2.16  Number  of  gravity -shock  sensor  reports  above  the  second  limit 
on  the  x-axis 

Not  assessed 

MOP  1.2.17  Number  of  gravity-shock  sensor  reports  above  the  first  limit  on 
the  y-axis 

Not  assessed 

MOP  1.2.13  Number  of  gravity -shock  sensor  reports  above  the  second  limit 
on  the  y-axis 

Not  assessed 

MOP  1.2.19  Number  of  gravity-shock  sensor  reports  above  the  first  limit  on 
the  z-axis 
Not  assessed 

MOP  1.2.20  Number  of  gravity-shock  sensor  reports  above  the  second  limit 
on  the  z-axis 

Not  assessed 
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MOP  1.2.2]  SME  assessinem  of  RF  tog  temperature  sensor 

SMEs  and  opera:o:s  indicated  tint  the  Rf  tag  teruperafure  censor  was  acceptable  for  measuring  tagged  muni¬ 
tions  pallets  ambient  temperature  (Figure  D-2).  One  nmmtims  SME  provided  tbit  comment.  "Although  the 
temperature  sensor  and  its  application  arc  acceptably  the  armminititjn  surveillance  comnmnit}'  has  no: 
caught  up  ft?  du'u  level  of  applicability."  Oae  ATOS  operator  stated  that  it  was  '"'Nice  to  see  that  this  capabil¬ 
ity  was  incorporated  m to  the  tag.  It  gave  the  warfighter  an  indicator  if  there  was  a  problem  with 
amtmmitons.7"'  SMEs  aSso  indicated  that  ardiough  ±e  RF  tags  on  the  outside  of  the  container  do  not  provide 
temperature  readings  for  the  inside  of  the  container,  the  capability  was  tetter  than  not  having  any  '.emperature 
measure  meats. 


Rate  the  acceptability  of  RF  tag  temperature  sensor 


Completely  Largely  Somewhat  Somewhat  Largely  Completely 

Unacceptable  Unacceptable  Unacceptable  Acceptable  Acceptable  Acceptable 


Figure  D-l.  Questionnaire  Results,  RF  Tag  Temperature  Sensor:  All  respondents  agreed  that  the 
temperature  sensors  were  acceptable. 


D-S 
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MOP  1.2.22  SME  assessment  of  RF  tag  relative  humidity  sensor 

SMEs  indicated  the  RE  sensor  concern  was  good  (Figure  D-3).  however,  the  current  application  of  ±e  RH 
sensor  needs  to  be  changed  to  be  usable  to  the  naval  warfighters.  The  placemen:  of  the  RH  sensor  should  reflect 
what  is  going  on  inside  of  the  sealed  container,  no:  on  the  outside  of  the  container.  One  warfighter  indicated  'The 
need  to  gei  relative  humidity  sensor  inside  the  container  The  questionnaire  responses  indicated  that  the  RH 
sensor  was  acceptable  for  providuig  RH  measures  on  tagged  munitions  pallets. 


Rate  the  acceptability  of  RF  tag  relative  humidity  sensor 


Figure  D-S.  Questionnaire  Results,  RF  Tap  RH  Sensor:  23  of  25  respondents  agreed  that  the  RH 
sensor  was  acceptable. 
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MOP  1.2.23  SME  assessment  of  RF  tag  environmental  sensor  reliability 

The  SME  indicated  the  RF  tag  environmental:  sensor  was  reliable  based  on  the  Limited  amount  of  nine  the 
warfighters  used  me  RF  tags.  iTigure  D-4j.  However,  all  warfighters  indicated  she  RP  tags,  performed  well 
during  the  demonstrations. 


Rate  the  reliability  of  RF  tag  environmental  sensor 


25 


Completely  Largely  Somewhat  SamBwhat  Largely  Completely 

Unreliable  Unreliable  Unreliable  Reliable  Reliable  Reliable 


Figure  D-4.  Questionnaire  Results.,  Tag  Environmental  Sensor:  lOO^c  of  warfighters  agreed  thus 
the  RF  tag  environmental  sensor  ^  as  reliable  daring  the  demonstration. 

MOP  1.2.24  SME  assessment  of  RF  tag  gravity-shock  sensor 

Not  assessed 

MGE  1.3  Capability  of  ATOS  RF  tags  to  communicate  with  RCU 
or  HHR _ 

This  MOP  assesses  the  RCU  capability  to  interrogate  the  RF  tags  and  die  HHR  capability  :o  query  RP  tags  for 
asset  and  environmental  data.  The  quesrionnaire  results,  indicated  die  data:  transfer  speed  for  reading  RF  tag  data 
usmg  the  HHR  was.  too  slow  while  conducting  pallet  receipt.  During  pallet  issue,  die  RP  tags  were  ab]e  to 
communicate  die  palle:  consent  changes  to  the  RCU  and  HHR.  During  pallet  transfer.  RP  tags,  were  able  to 
communicate  the  latest  asset  and  environmental  data  Co  die  RCU  and  HHR.. 

MOP  1.3.1  Number  of  ATOS  RF  tags  that  we?re  able  to  communicate  with 
RCU  or  HHR 

Mies.au  demonstration:  During  die  first  interrogation  cycle,  die  RCU  defected  199  out  of  200  RP  tag's  (99  .5%)  m 
a  60  x  40  x  15  foot  earth-covered  magazine  usmg  three  RFEs.  The  RCU  detected  169  out  of  174  tags  (97.1%) 
in  a  7D  x  200  foot  ASP  using  eight  RFEs.  During  the  second  interrogation  cycle.  100%  of  the  RP  sags  were 
detected. 
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CAAA  demonstration:  The  RCU  detected  197  out  of  200  tags  (9B.5“-n)  in  both  she  IDO  x  50  x  ID  foot  earth- 
covered  magazine  using  6  RFEs  and  the  200  x  50  foo:  storage  warehouse  using  12  RFEs.  During  the  second 
interrogation  cycle.  100%  of  the  RF  tags  were  detected. 

Man  rime  demonstration  The  HHR  detected  60  out  of  60  RF  tags  (100%)  in  a  ID  x 22  x  8  foot  magazine  on  the 
USS  Ponce.  On  the  USS  Harry  S.  Truman,  tbe  RCU  detected  200  out  of  200  RF  tags  (100%)  in  a  45  x  SO  x  10 
foot  magazine  using  3  RFEs. 

MOP  1.3.2  Automatic  reporting  frequency  from  RF  tag  to  RCU 

A  RCU  performance  log  was  used  at  tbe  Viesau  and  CAAA  demonstrations  to  Disinter  the  start  and  stop  time  s 
of  tbe  RCU  interrogation  cycles.  The  results  indicated  that  the  RCU  interrogated  the  RF  tags  ere"-  60  minutes. 

MOP  1.3.3  Ort-command  reporting  to  HHR 

On-command  reponing  is  the  HHR  ■:  apabihty  to  perform  ro^]  call  or  find  functions.  At  the  Miseau  demonstration, 
the  warfighters  used  the  HHR  find  fimcuou  to  locate  five  tagged  munitions  pallets.  AJ1  five  tagged  pallets  were 
located  using  tbe  HHR  No  major  problems  mere  observed  during  the  demons  (rations.  At  the  CAAA  demon¬ 
stration.  warfighters  were  abie  to  conduct  an  inventory  of  20  RF  tags  m  an  earth-covered  magazine  within  20 
nimutes.  The  warfighters  indicated  this  function  was  a  tune  saver.  During  the  maritime  demonstratiom  the  HHR 
was  effective  in  performing  a  rapid  tally  (within  10  minutes)  of  60  RF  tags  inside  tbe  USS  Ponce's  10  x  22  x  S 
storage  facility.  On  die  U5S  Harry  5.  Truman.  Det  1  AFOTEC  performed  a  roll  call  of  200  RE  rags  within  15 
minutes.  ‘'Trie  warfighters  indicated  the  s\:stem  seemed  jicn;  bur  I  feel  it  mil  execute  better  when  rhe  frugr 
oiv  worked  our.  "  Figure  D-5  shows  responses  so  the  on-command  repairing  to  die  HHR  questionnaire  state¬ 
ment. 


Rate  the  acceptability  of  on-command  reporting  to  HHR 


Unacceptable  Unacceptable  Unacceptable  Acceptable  Acceptable  Acceptable 


Figure  D-5.  Questionnaire  Resahsj  On-Command Report:  All  responses  agreed  that  ihe  HHR  on- 
cojtimand  repotting  li'ac  lT c l  eu table . 
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MOP  1.3.4  On-command  memory  reset  from  HHR 

During  the  creation  of  a  new  RP  tag.  the  RP  tag  was  gLven  a  command  by  the  HHR  to  clear  it:  memory.  The 
assessment  team  observed  that  IS  warfighter:  successfully  cleared  the  RP  rag's  memory  before  inputting  asset 
data  into  ±e  RP  tag.  Ibis  process,  was  a  cne-time  acUon  that  was  conducted  by  the  TM  staff  and  ATOS 
participants  durmg  pallet  receipt.  The  warfighter  stated  that  ''The  tag  must  fee  mutable,  ue  mwitf  iujve  options 
zo  rewrite  the  mg  for  different  items."  Figure  D-6  shows  the  response  :o  the  questionnaire  statement  about  the 
on-command  memory  reset. 


Rate  the  acceptability  of  on-command  memory 
reset  from  HHR 


Prj'icrf  D-6.  Questionnaire  Results,  On-Command  Memory  Reset:  27  of  29  respondents  agreed  the 
on-command  memo?-}'  reset  was  acceptable. 


MOP  1.3.5  Percentage  qfRF  togs  properly  identified  by  their  assigned  ID  manber 

During  the  Miesau  and  CAAA  demonsuuticois.  the  warfighter:  assigned  ID  □umbers  to  20  RP  tags.  The  warfighters 
were  able  to  identify  all  20  RP  tags  using  the  HHR.  Durmg  the  maritime  detnonstradou.  the  warfighters  assigned  ID 
numbers  to  £0  RP  tags.  The  warfighters  w  ere  able  to  properly  identify  all  60  RP  tags  by  then  assigned  tag  D  numbers. 
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MOP  1.3.6  RF  tag  identifier  humanly  visible 

The  assessment  ream  observed  that  sbe  warfighters  were  able  to  visually  identify  20  selected  RF  tap  by  their  ID 
numbers  at  each  demonstration.  No  distance  reqmremeiila  wai  stipulated  in  tbe  FPD.  One  warfighter  ^stated  that  tbe 
"ID  number  ^em  readable  and  earth  'located.''  Figure  D-7  shows  responses  to  the  questionnaires  statement 
about  identifying  RF  tags  unique  ID  number. 


Rate  the  visibility  of  the  RF  tag  ID  number 


Figure  B-  Questionnaire  Results,  Identifying  the  RF  Jags'  ID  Number:  All  rezptmzes 
agreed  that  j^ie  unique  ID  number  n rax  identifiable  oj r  the  RF  tags. 


MOP  1.3.  7  RF  rag  barcode  readable 

The  HHR  was  able  to  read  tbe  200  RF  tag  barcodes  at  each  demonsTation  site,  but  based  on  assessment  team 
observations,  tbe  HER  bad  some  problems  reading  the  RF  tag  barcode  if  tbe  warfighter  didn't  place  the  HHR 
close  enough  to  she  RF  sag  to  read  the  barcode.  Severn!  warfiglrers  stated.  "[The]  HHR  had  some  difficult 
reading  rags  consistently.''  Figure  D-S  shows  responses  to  tbe  questionnaire  sratemen;  about  the  readability  of 
die  RF  rag  barcode. 


Figure  B-S.  Questionnaire  Result*,  RF  Tag  Barcode  Readability:  All  responses  agreed  that 
the  RF  tag  barcode  readability  was  acceptable. 
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MOP  1.3.3  RF  tag  low  batten  power  indication  [backup  hatter)7] 

The  TECEVAL  data  revealed  that  20  RF  tags  switched  over  to  their  backup  bakeries  and  seat  batter,'  flag1:  to  the 
PP  when  their  mam  cells  fell  below  3.2  volts.  During  the  maritime  demonstrations.  the  assessment  team  ob¬ 
served  one  RF  tag  transmitted  a  batten-  flag.  Some  of  the  warfighters  indicated.  "The  RF  rag  nsede. d  a  small 
light  emitting  diode  or  a  test  pan  to  check  the  amount  of  electrical  power  left  in  the  battery. 

MOP  1.3.9  Operator  assessment  of  the  RF  tag  low  battery  power  indicator 

The  assessment  team  received  positive  comments  about  toe  RF  tag  low  bastery  power  indicator  (Figure  D-9). 
Some  warfighters  felt  it  would  be  beneficial  to  have  a  usual  indicator  on  theRF  tag  itself  that  displays  «hen  the 
batten  has  Switched  over  to  the  backup  [batten7]  rather  than  having  to  check  tbe  PP  for  a  flag  indication.  This 
would  allow  more  time  to  change  out  the  batten  and  not  risk  losing  vital  information.  Other  warfighters  recom¬ 
mended  that  the  RF  tags  should  have  a  usual  indicator  on  the  outside  of  the  RF  tag  casing.  The  questionnaire 
responses  indicated  the  RF  tag  low  batten'  power  indicator  was  acceptable  for  momtcring  tbe  batten-  power 
levet  outlie  RF  tag. 


Rate  the  acceptability  of  RF  tag  low 
battery  power  indication 


Figure  D-9.  Questionnaire  Re- suits.  RF  Tag  Law  Battery  Power  Indicator:  25  of  27  respondents 
agreed  that  the  RF  tag  low  battery  power  indicator  i  vas  a  coop  table. 


MOP  1.3.10  Detection  range  between  RF  tags  and  HHR 

The  maximum  detection  range  between  RF  rags  and  he  HER.  was  approximately  £0  feet  based  on  assessment 
team  observations. 

MOP  1.3.11  Detection  range  between  RF  tags  and  RCU 

The  TECEVAL  data  indicated  the  maximum  detection  range  for  the  RCU  was  approximately  100  feet. 

MOP  1.3.12  RF  tag  transmitter  radiation  parameters 

The  RF  tag  transmitter  power  was  at  240  milliwatts  (mW).  which  met  HERO  requirements. 

MOP  1.3.13  RF  rag  transmitter  frequencies 

The  RF  tag  transmitter  frequency  was  433.92  Megahertz  (MHz),  which  met  HERD  requirements. 
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MOP  1.3.14  Anti-collision  communications  between  RF  tag,  HHR,  and  RCU 

Tin1]  MOP  assesses  any  communication  conflicts  between  ATOS  components.  Dining  the  CAAA  and  maritime 
demonstrations.  the  assessment  team  observed  interopaability  problems  between  the  HHR  and  RCU.  The 
assessment  team  observed  that  she  HHR  did  no:  work  while  the  RCU  was  interrogating  RP  tags.  One  HHR 
would  loch  up  if  another  HHR  were  in  close  prommity. 

MOP  1.3.15  Half-duplex  communications  between  RF  tag,  HHRr  and  RCU 

The  assessment  team  observed  a  few  problems  with  dasa  transfer  between  HHR  and  PR  During  the  maritime 
demonstration  on  ±e  USS  Ham-  S.  Truman,  me  system  was  not  successful  in  transferring  ISO  transaction 
records  from  she  HHR  to  the  PP  hi  addition.  ADDS  was  not  successful  in  transferring  on  inventory  list  chat 
contained  data  from  f  DO  RF  tags  from  the  PP  :o  the  HHR. 

MOP  1.3.16  Opera  tor /SME  assessment  of  their  ability  to  change  the  RF  tag 
user-selectable  temperature  limit  from  HHR 

The  questionnaire  responses  indicated  changing  the  RF  tag  user- 
selectable  temperature  was  acceptable  and  easy  using  the  HHR 
(Figure  D-1Q). 


efEap»-  to  do  it!" 

USS  Harry  S.  Truman  warfighter 


Rate  the  acceptability  to  change  the  RF  Tag 
temperature  limit  settings. 


'To  accommodate  l^e  flrs*|*r  ru Tiber  at  rcipar.scE,  tne  ^raDh  s  i -  ass  Incrs-ttsa 


Figure  D-10.  Questionnaire  Results.,  Change  RF  Tag  Feniperciure  Limit  Settings:  All  respondents 
agreed  th at  changing  the  RF  tag  temperature  limits  wing  the  HHR  was  acceptable. 
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MOP  i.i.  I  7  Opera  ror/SME  assessment  of  I  hen’  ability  to  change  RF  tag 
user-selectable  relative  humidity  limit  from  HHR 

Que&tioaaaiie  responses  mdicated  cbaasiog  tbe  PJ  user- 

s elec  table  RE  limit  was  acceptable  and  easy  mm2  the  HHR  No  problems  m  ckmgi  ng  limits 
(Figme  D-ll).  Mie^eau  warfighter 


Rate  the  acceptability  to  change  the  RF  Tag 
relative  humidity  limit  settings. 


35-, 


Completely  Largely  Somewhat  Somewhat  Largely  Completely 

Unacceptable  Unacceptable  Unacceptable  Acceptable  Acceptable  Acceptable 


'7c  sccsrr medals  Lr-c  g-saltr  number  □'  -c-spur  s-cs-,  Lnc  graph  slzs  *■:  =  Inc-saicd. 

Figure  D-ll.  Questiotmaue  Results.,  Change  RF  Tag  RH  Limit  Settings:  All  respondents  agreed 
that  changing  the  RF  tags  BJJ  limits  using  the.  HHR  v,-as  acceptable. 
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MOP  1.3.18  Qperaior/SME  assessment  of  the  reader  capability  to  obtain  RF 
tag  unique  ID  number 

Questionnaire  r^po^es  indicated  obtaining  the  RP  mg  unique  ID  number  using  the  HHR  was  effective  {Figure 
D-lJj  Logistics  and  munitions  SME-s  indicated  that  die  HHR  would  sometimes  have  difficulty  picking  up  the  RF 
tag  ID  number  from  me  HHR  but  would  eventually  read  it.  One  iOgLstics  SME  stated.  "I  th ink  fns  capability'  is 
jri-ep  t"  bur  needs  some  improvement  [in]  this  area.17 


Rate  the  effectiveness  of  the  HHR  or  RCU  to 
obtain  the  RFTag  unique  (D 


Completely  Largely  Somewhat  Somewhat  Largely  Completely 

Ineffective  Ineffective  Infective  Effective  Effective  Effective 

To  idcommodat-s  ire  fl--ta:er  number  n?  jesp-nrsie-s,  tne  graph  scale  was  icre-assc. 


Figure  D-12.  Questionnaire  Results,  Obtain  RF  Tag  Unique  IB  Number:  63  of  69  of  respondent! 
agreed  that  using  the  HHR  or  RCU  to  obtain  the  RF  tag's  unique  ID  os  effective 
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MOP  1.3.19  Opera  tor/SME  assessment  of  RF  tag/reader  communications 

Questionnaire  results,  indicated  that  lie  HER.  and  RCU  were  acceptable  for  transferring  RJ  tag  data  despite 
technical  problems  encountered  during  die  demonstration 5.  Al- 

rboogh  the  results  were  positive  (Figure  D-13),  the  warfighters.  ‘'Process  slew  at  rimes.  HHF,  had  ptvb- 
complaiued  tba:  the  read  and  write  proces  sing  speed  of  the  HH?.  letns  in  wading  RF  tags. 
□^improvement  “  Warfightere 


Rate  the  acceptability  ef  transferring  RF  tag  data 
to  the  HHR  and  RCU 


Figure  D-13.  Questionnaire  Results,  Transfer  RF  Tag  Data  to  r he  HHR  and  RCU:  61  of  64 
respondents  agreed  that  the  HHF.  or  RCU  was  acceptable  for  transferring  RF  tog  data. 

MOE  1.4  Capability  of  ATOS  HHR  and  RCU  to  communicate  and 
transfer  data  to  PF _ 

This  MQE  assesses  the  capabibly  of  die  RCU  and  HER.  to  transfer  stored  RJ  tag  data  ro  the  FR  Dining  pallet 
receipt,  the  HHR  was  not  able  to  transfer  a  large  number  of  transaction  records  (i-e.,  180  our  of  200  transaction 
records)  to  die  PR  as  the  HHR  software  would  lock  up  after  a  couple  minutes.  During  the  CAAA  demonstra¬ 
tion.  the  assessment  ream  observed  that  when  the  warfighters  docked  the  HHR.  some  transaction  records  did  net 
get  transferred  to  the  PP  and  other  trass  action  records  were  deleted  from  the  HHR.  To  resolve  the  problem,  the 
TM  reduced  the  number  ef  transaction  records  that  were  transmitted  to  the  PP  to  oniiy  50  transaction  records  at 
a  time. 

MOP  1.4.1  Percentage  of  HHRs  that  were  able  to  Transfer  data  to  PP 

During  the  Miesan  demonstrations,  all  four  HHRs  transferred  trass  action  records  to  die  PP  during  pallet  receipt. 
The  assessment  ream  compared  the  count  of  the  handwritten  inventory  list  ro  die  conus  of  the  PP  inventory  hst. 
This  comparison  was  accomphslied  at  all  demonstration  sites. 

Dining  die  CAAA  demonstration,  all  three  HHRs  transferred  transaction  records  to  the  PP  during  pallet  receipt. 
The  assessment  ream,  observed  technic  a[  problems  wish  the  dara  transfer  of  transaction  records  from  the  HHR 
to  the  PP.  This  was  die  first  time  die  assessment  ream  observed  a  problem  with  die  RP  tags  hatting  corrupted 
serialized  data  on  the  RF  tags,  which  required  the  TM  to  purge  the  PP  database. 

During  the  demonstration  onboard  the  USS  Pence,  all  three  HHRs  transferred  transaction  records  to  rhe  PP 
during  pallet  receipt.  A  tota]  of  60  out  of  61}  transaction  records  were  successfully  rransferred  ro  the  PR 
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Four  HHRj:  were  taken  to  the  demonstration  onboard  'lie  USS  Harry  S.  Truman;  however  sue  of  the  four  HEP.s 
was  not  fully  charged  and  therefore  Dot  available  for  assessment.  Of  the  three  remaining  HEP.S.  ah  were  abte  to 
transfer  records  to  the  PP  during  pallet  receipt.  Dining  this  demons"ration.  die  assessment  team  learned  that  the 
HEP.  was  not  able  to  transfer  1  SO  Tansaehon  records  to  die  PP.  The  TM  developed  a  work  around  solution  to 
transmit  smaller  packets  (50 transaction  records  per  packet)  to  ±e  PP.  and  these  transmissions  were  successful. 
One  warfighter  stated.  '  Time  were.  still  some  gtitchss  in  download  process.  Data  transferMriting  capabili¬ 
ties  are  sluggish.  Would  like  to  have  faster  processing  of  information. Figure  D-14  shows  responses  to 
the  effectiveness  of  data  transfer  from  the  HHR  so  PP. 


Rate  the  effectiveness  of  data  transfer  from  HHR  to  PP 


25 


Completely  Largely  Somewhat  Somewhat  Largely  Completely 

Ineffective  Infective  Ineffective  Effective-  Effective  Effective 


Figure  D-14.  Questionnaire  Result  Effectiveness  of  Dam  Transfer  from  HHR  to  PP:  AU 
respondents  agreed  that  the  data  transfer  from  the  HHR  io  the  PP  was  effective. 

Figure  D-I5  shows  responses  to  she  questionnaire  statement  about  AI03  supporting  data  transfer  from 
HEP  to  PP. 


Rate  the  acceptability  of  the  ATOS  system  to  support 
data  transfer  from  the  HHR  to  the  PP 


Figure  D-l  5.  Questionnaire  Results,  ATOS  System  Supports  Data  Transfer  from  the  HHR  to  the 
PP:  All  respondents  agreed  the  HHR  to  the  PP  transfer  was  acceptable. 
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MOP  1.4.2  Percentage  of  ECUs  that  m  'ere  able  to  communicate  and  transfer 
data  to  PP. 

Both  RCUs  used  during  the  Mies.au  demonstration  were  able  to  communicate  data  to  the  PP  The  RCU  in  the 
earth- covered  magazine  mmsferted  interrogated  RF  tag  data  to  the  PP  via  WLAN  The  second  RCU  trans¬ 
ferred  data  via  a  serial  pon.  This  R.CU  had  a  data  transfer  problem  when  communic  ating  with  the  HHP..  which 
was  resolved  by  a  software  change.  Toe  assessment  seam  observed  the  transfer  of  the  interrogated  RF  tag  data 
to  he  PP  by  using  the  EHR  and  verified  that  the  PP  mven tory  mr-sched  the  hst  of  RF  tags  placed  inside  he  test 
site.  The  assessment  team  also  verified  the  pallet  count  changes  were  updated  on  the  PP. 

Two  RCUs  were  used  in  the  CAAA  demousTatton.  One  RCU  was  installed  in  an  earth-  covered  magazine  and 
he  other  wras  installed  in  a  storage  warehouse.  Both  RCUs  were  connected  to  a  PP  via  WLAN  and  both  were 
successful  is  transferring  interrogated  RF  data  to  the  PP.  The  assessment  team  verified  that  the  PP  inventory 
matched  the  List  of  RF  tags  phced  inside  he  rest  sites  and  that  the  pallet  count  changes  were  updated  on  the  PP. 

One  RCU  was  used  in  the  man  rime  demonstration  on  the  USS  Harry  S.  Truman,  and  was  successful  in  transfer¬ 
ring  interrogated  RF  tag  data  to  the  PP  via  a  LAN.  The  assessment  team  verified  that  the  PP  inventory' matched 
he  hst  of  RF  tags  placed  inside  he  test  site  and  the  pallet  count  changes  were  updated  on  he  P?  Most  of  the 
warfighters,  indicated,  “Slow  processing  speed  does  not  always  pick  up  the  RF  tag  information  Overall,  it 
seems,  to  wort  ok.''  Figure  D-ld  shows  responses  to  the  questionnaire  statement  about  data  transfer  for 
several  RF  tags  to  the  RCU  and  PP. 


Rate  the  acceptability  of  the  ATOS  system  to  support 
data  transfer  from  several  RF  Tags  to  the  RCU  and  PP 


1C 


Figure  D-16.  Questionnaire  Results,  ATOS  5yimrj  Supports  Data  Transfer  from  Several  RF  Tags 
to  the  RCU  and  PP:  All  respondents  agreed  the  data  transfer  of  the  RF  togs  to  the  RCU  and  PP 
was  acceptable. 
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MOP  1.4.3  SME  assessment  of  HHR-PP  connectivity 

Questionnaire  responses  indicated  that  the  HHR-:o-FP  ccnmedivity  was  usable  during  the  demonstrations  (Fig¬ 
ure  D-17);  however,  the  assessment  "earn  observed  several  data  transfer  problems  during  pallet  receipt.  One 
warfighter  stated.  '[It]  smms  when  docking  the  HHR  tier's  waj  some  problems  with  data  twins  for.'  Al¬ 
though  the  HHR-to-PF  data  transfer  process  was  usable,  die  warfighters  stated  it  needed  improvement. 


Rate  the  usability  of  the  HHR-PP  connectivity 


Figure H-17.  Questionnaire  Results,  HHR-PP  Connectivity:  Ail  respondents  agreed  that  the  HHR- 
PP  con  ntrrfrn'j-i  ircrr  ujafrJe. 

MOP  1.4.4  WEAN  transmitter  radiation  parameters 

The  WLAN  power  was  lOOmW  tdfeclive  isotropic  radiated  power,  which  meets  the  HERO  requirement  for  a 
COTS  product. 

MOP  1.4.5  WLAN  transmitter  frequencies 

The  WLAN  transmitter  frequency  was  2.5  Gigahertz. 

MOP  1.4.6  Detection  range  for  WLAN  between  RCU  and  PP 

At  the  Miesau  demonstration,  a  lme-of-si  gbt  connexion  was  established  with  die  RCU  inside  the  earth -covered 
magazine  and  the  PP.  which  was  located  an  eighth  of  a  mile  away.  Tne  assessment  team  did  no:  observe  any 
issues  wiftL  RCU'  and  PP  connectivity  using  the  WLAN. 

At  die  CAAA  demonstration,  two  WLANs  were  installed  at  die  test  sites.  Tne  first  WLAN  required  a  repeater 
on  top  of  a  75-foot  water  tower  to  establish  a  1.5  mile  connection  so  die  PP.  The  second  WLAN  was  a  lme-of- 
siebt  connection  that  was  test  than  0.5  mves  away  from  the  PP.  At  both  test  sites,  the  WLAN  was  able  to 
provide  reliable  connectivity  from  the  RCU  to  the  PP  throughout  the  demonstration. 
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MOP  1.4.7  Operator  assessment  of  HHR ,  RCU,  and  PP  communication  and 
data  transfer  interface 

Questionnaire  responses  indicated  tbe  commiinicaidDns  and  data 
transfer  interface  between  the  HHR.  RCU.  and  PP  was  ac¬ 
ceptable  for  tbe  demonstrations  B-1S):  however,  roost 

of  the  warfighters  believed  the  data  Tansfe:  interface  between 
the  HHR.  RCU.  and  PP  needs  improvement. 


'  'Still  n  zeds  [sic]  10Q %  assurance  that 
jrj^  HHR  will  wwfr  wijft  the  PP  '' 

Crane  Warfighter 


Figure  D-1S.  Questionnaire  Results.,  BBS,  RCU,  and  PP  Communication  and  Data  Transfer:  All 
respondent  agreed  that  the  HHR,  RCUr  and  PP  connectivity  lrcr^  acceptable, 


MOE  1.5  Capability  of  ATOS  PP  to  interoperate  with  Service 
Ammunition  AIS _ 

Ibis  MOE  was  not  assessed  because  the  Service  Ammunition  AIS  was  not  available  during  the  demonstrations. 

MOE  1.6  Capability  of  ATOS  PPto  interoperate  with  EDB 

Ibis  MOE  was  net  assessed  because  die  EDB  was  not  available  during  the  demonstrations. 

MOE  1.7  Characterization  of  network  bandwidth  connectivity  to 
ATOS  PP _ 

Ibis  MOE  assesses  the  data  connectivity  of  the  PP  from  tbe  HHR  and  RCU.  Ibe  HHR  docking  station  was 
conuecsed  to  ±e  PP  by  an  Etherae:  connection.  A  LAN"  or  a  WLAN  were  used  :o  connect  ±e  RCU  to  the  PP. 
During  tbe  Mesaii.  CAAA.  and  mantime  demonstrations,  the  assessmen:  seam  did  no;  observe  any  network 
bandwidth  problems  that  would  impact  data  transfer  from  the  RCU  to  the  PP  or  from  the  HHR  and  PP. 
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MOP  1.7.1  Bandwidth  between  HHR  and  PP 

The  HHR  docking  station  was  connected  to  tbe  PP  by  an  Ethernet  connection.  The  bandwidth  was  250  Mega¬ 
bytes  (MB)/ second.  When  the  HHR  was  placed  into  the  docking  station,  tbe  data  were  automatically  down¬ 
loaded  to  die  PP.  As  stated  earlier,  the  TM  needed  to  ffc  the  software  on  the  HHR  and  PP  to  resolve  data 
transfer  problems  encountered  during  die  demonstration.  The  assessment  team  did  not  observe  any  data  transfer 
problems  involving  network  bandwidsb. 

MOP  1.7.2  Bandwidth  between  RCU  and  PP 

The  assessment  team  observed  no  problems  wish  network  bandwidth  between  die  RCU  and  PP.  The  TECEVAL 
data  revealed  the  WLAN  bandwidth  was  10  MB  second,  which  is  the  commercial  standard  for  a  WLAN;  and 
250  MB  second  via  Ethernet  connection. 

MOP  1.7.3  Operator  assessment  of  bandwidth  between  HHR  and  PP 

The  operators  had  insufficient  knowledge  to  assess  bandwidth.  The  assessment  team  did  not  collect  any  band¬ 
width  data  durmg  the  demonstration. 

MOP  1.  7.4  Operator  assessment  of  bandwidth  between  RCU  and  PP 

The  operators  had  insufficient  knowledge  to  assess  bandwidth.  The  assessment  team  did  not  collect  any  band¬ 
width  data  durmg  the  demonstration. 


MOE  1 .8  Capability  of  AT  OS  system  to  protect  data 

The  assessment  team  was  unable  to  assess  network  security  since  a  security  SME  was  not  available  during  the 
demonstrations. 


MOE  1.9  Capability  of  ATOS  system  to  provide  sufficient  data 
storage 

This  MOE  assesses  the  data  storage  capability  of  the  HHR  RCU,  and  PP  The  assessment  team  did  not  observe 
any  data  storage  L&sues  with  ATOS  during  the  demonstrations.  The  HERO  requirements  for  the  demonstrations 
restricted  the  number  of  RE  tags  that  could  be  used  to  support  the  assessment:  as  a  result  only  UDORF  tags  could 
be  used  for  each  test  facility  per  demonstration. 

MOP  1.9.1  HHR  storage  memory  capacity 

The  HHR.  storage  memory  capacity  was  64  MB  of  read-only  memory  and  64  MB  random-access  memory  The 
assessment  team  did  not  observe  any  data  storage  issues  during  she  demonstrations. 

MOP  1.9.2  RCU  storage  memory  capacity 

The  RCU  storage  memory  capacity  was  256  MB.  The  assessment  team  did  not  observe  any  data  storage  issues 
during  the  demonstrations. 

MOP  1.9.3  PP  storage  memory  capacity 

The  PP  storage  memory  capacity  was  based  on  the  laptop  computer  hard  drive  storage  capacity  which  was  over 
40  Gigabytes.  PP  storage  capacity  was  never  an  issue  during  the  demonstrations. 
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MOP  1.9.4  SME  assessment  of  RF  rag  da  fa  storage 

Questionnaire  results  indicated  the  warfighters  believed  the  RP  tag  data  storage  was  usable  and  adequate  to 
support  munitions  management  (Figure  D-19).  Most  of  the  warfighters  agreed  that  having  RT  tagti  with  large 
memory  would  be  useful  for  changing  and  storing  additional  information  about  the  tagged  munitions  pallets. 


Rate  the  acceptability  of  the  RF  Tag  data  storage 


Completely  Largely  Some  whet  Somewhat  Largely  Completely 

Unacceptable  Unacceptable  Unacceptable  Acceptable  Acceptable  Acceptable 


Figure  D-19.  One  straw  noire  Results,  RF  Fog  Dai i  Storage:  All  reipor.de.  me  agreed  JrJ-a  r  the  RF 
iag  data  storage  was  acceptable. 


MOP  1.9.5  SME  assessment  of  data  storage  for  HHR  and  RCU 

Questionnaire  results  mdicate d  the  SME:  believed  the  HHR  and  RCU  data  storage  was  usable  and  adequate  to 
support  mumtkms  management  [Figure  D--0).  ATOS  data  storage  capacity  was  never  exceeded  during  any  of 
±e  demonstration:. 


Rate  the  acceptability  of  the  HHR  and  RCU  data  storage 


Figure  B-20.  Questionnaire  Results,  HHR  and  RCU  Data  Storage:  All  the  SliIEs  agreed  that  the- 
HHR  flPid  RCU  data  storage  was  acceptable. 
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MOP  1.9.6  SME  assessment  of  PP  data  storage. 

The  questionnaire  re^iilt-i  indicated  that  the  PP  data  storage  was  usable  and  adequate  to  support  munitions 
management  at  the  Mean  and  CAAA  demonstrations  (Figure  D-21).  Only  the  accountable  record  managers 
responded  to  this  questionnaire  statement. 


Rate  the  acceptability  of  the  PP  data  storage 


Figure  D-21.  Questionnaire  Results,  PP  Beta  Storage:  JR  SMEs  agreed  that  the  PP  data  storage 
was  adequate. 


\IOE  1 .10  Cliamc feiizatiou  of  ATOS  RCIT  antenna  coverage 

This  MOE  assesses  aiitemia  coverage  of  the  RCU  inside  an  earth-covered  magazine,  storage  warehouse,  or 
shipboard  magazine.  Tne  RCU  and  REE  were  effective  in  providing  adequate  antenna  coverage  to  detect  200 
RP  tags  during  the  demonstrations. 

During  the  first  interrogation  cycle  at  the  Miesau  demonstration,  the  RCU  detected  199  out  of  2  DC  RP  tags 
(99.5%)  in  a  60  k  40x  15  foot  eaith-covered  magazine  with  three  RFEs:  169  out  of  17- tags  (97.1%)  m  a  70  x  200 
foot  ASP  with  eight  RFEs.  During  tie  second  and  tlnrd  interrogation  cycles,  the  RCU  detected  1 00*  c  of  the  RP 
tags.  The  warfighters  expressed  some  concerns  about  the  application  of  AIDS  in  an  ASP.  One  Miesaii  warfighter 
stated.  ::For  an  e? iclosed  location  the  system  seems  w  w#  weM  The  problem  I  see  is  in  wtarr  was  de¬ 
scribed  she  ASP  application.  In  an  open  area,  the  requirement  could  be  extensive f  depending  cm  rfie 
size  of  the  area  to  be  coveted. Another  concern  ls  that  a  :nng  of  antennas1  around  a  storage  area  may  uct  be 
possible  due  to  terrain  restrictions. 

During  die  CAAA  demonstration,  the  RCU  detected  197  out  of  200  tags  (98.5%)  in  both  the  100  x  50  x  10  foot 
earth-covered  magazine  using  6  RPEs  and  the  200  x  50  foot  storage  warehouse  using  12  RFEs.  Dunns  the 
mantime  demonstration,  tie  RCU  detected  60  out  of  60  RE  tags  (100%)  in  a  1C  x  22  x  8  foot  magazine  ou  the 
USS  Ponce  and  200  out  of  200  RF  tags  (100%)  m  a  45  x  SO  x  10  foot  magazine  using  5  RPEs  on  die  USS  Harry 
S  Truman 

MOP  1.10.1  Antenna  coverage  between  RCU  and  RF  tag 

During  all  demonstrations,  tie  RCU  detected  approximately  9£%  of  the  RF  tags  on  die  first  interrogation  cycle, 
and  100%  after  two  o:  three  mteirogaion  cycles. 
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MOP  1.10.2  Opera  tor/SME  assessment  of  antenna  coverage  between  RCU 
and  RF  tag 

Questionnaire  results,  indicated  that  the  RCU  and  REEs  were  acceptable  and  provided  adequate  antenna  cover¬ 
age  L^i&ide  the  magazine  [Figure  D-21' 


Rale  the  acceptability  of  the  antenna  coverage 


Completely  Largely  Somewhat  Somewhat  Largely  Completely 

Unacceptable  Unacceptable  Unacceptable  Acceptable  Acceptable  Acceptable 


Figure  D-22.  Questionnaire  ResuJtsr  Anitnna  Coverage  betwee? i  the  RCU  and  RF  Tag:  All 
respondents  agreed  that  the  antenna  coverage  r:as  acceptable  during  the  demonstrations. 

MOE  1.11  Capability  of  ATOS  RCU  to  detect  RF  tags  at  initial 

Thii  MOE  assesses  the  perfotmance  of  the  initial  detection  of  the  RJ  tap  by  the  RCU.  During  die  Mies.au  and 
CAAA  demonstrations,  the  RCU  was  able  to  detect  more  than  97%  of  200  RE  tags,  and  during  the  maritime 
demonstradcn  detected  100°  i>  of  200  RE  tags. 

MOP  1.11.1  Initial  RF  tag  detection  using  RCU  within  145  mi  mites 

The  AIOS  system  was  able  to  detect  over  97%  of  die  RE  tags  within  14  minutes  o:  the  first  interrogation  cycle 
during  the  operational  demonstrations.  At  the  Miesau  demonstration,  the  first  RCU  detected  199  out  of  200  RE 
tags  (99.5%)  during  the  first  interrogation  and  the  ASP  RCU  detected  194  out  of  200  RE  tags  (97.1%).  At  the 
CAAA  demonstration,  the  RCU  detected  197  out  of  JOG  RE  tags  (93.?%)  during  the  first  mterroganou  inside  the 
earth- covered  magazine  and  storage  warehouse.  At  the  matt  tune  demonstration  on  die  USS  Ham-  S.  Truman, 
the  RCU  detected  200  out  of  20D  FT  tags  during  the  firs'  interrogation  inside  the  ship  magazine. 

MOP  1.11.2  Initial  RF  rag  detection  using  RCU  within  215  minutes 

Not  assessed.  The  assessment  team  was  not  able  to  verify  missing  or  new  RE  tags  were  detected  within  215 
minutes  based  on  how  die  AIDS  system  interrogates  RF  tags  using  the  short  and  lcng  read  cycles. 


D-24 


Advanced  Technology  Ordnance  Surveillance  Final  Report 

For  Official  Use  Only 


144 


MOE  1.12  Usability  of  ATQS  HHR  input  devices _ 

This  MOE  assesses  the  operators'  ability  to  use  ilie  keypad  and  stylos  to  input  data  on  die  HHR.  During  all 
demonstrations.  die  operator1]  were  able  to  use  die  HHR  keypad  aud  stylus  :o  iuput  asset  data.  Most  of  die 
operators  preferred  using  die  liquid  crystal  display  (LCD)  keypad  rather  dian  the  HHR  keypad  to  input  asset 
data.  Even  when  wearing  bulky  gtoves:  the  operators  were  ab*e  to  edit  asset  iiiformanou  and  perform  the 
munitions  management  tasks  using  'die  HHR  keypad. 

MOP  1.12.1  HHR  keypad  input. 

The  questionnaire  responses  indicate  that  the  HHR  keypad  was  usable  to  ad  "die  respondents  (Figure  D-23). 
During  padet  receipt,  pallet  transfer,  and  inventory  maintenance.  warfighters  preferred  :o  use  die  LCD  keypad 
and  stylus  to  input  asset  information  data  on  the  HHR.  Questionnaire  respouses  indicated  the  HHR  keypad  was 
usable  for  data  entry  (Figure  D-24). 


Figure  D-23.  Questionnaire  Results,  Usability  o  f  HHR  Keypad;  All  respondents  agreed  that 
the  HHR  keypad  was  usable. 


Figure  D-14.  Questionnaire  Remits,  Usability  of  HHR  Dam  Entry:  All  respondents  agreed 
Thai  the  HHR  mgs  usable  for  data 
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MOP  I.1 2.2  HHR  stylus  input 

The  warfighters  were  able  to  use  the  styius  to  input  asset  lManmtkm  {Figure  D-25)  and  they  found  it  especially 
useful  when  wearing  bulky  gloves:. 


Rate  the  usability  of  the  HHR  stylus 


Figure  D-25.  Questionnaire  Results,  Usability  of  HHR  Stylus:  32  of  S3  respondents  agreed  Thai 
ihe  HHR  stylus  was  usable. 
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IMOE  1.13  Capability  of  ATOS  HHR  to  create  RF  tags  and 
barcodes _ 

This  MOE  assesses  the  capability  to  use  die  HER  :o  create  new  RF  sags  and  barcodes.  During  the  demonstra¬ 
tion.  the  HHR  was  not  used  to  create  barcodes.  Instead,  the  barcode  template  was  created  by  the  TM  using  a 
barcode  machine.  Warfighters  were  able  to  use  the  HER.  to  inpu:  asset  information  on  new  RP  tags  using 
barcode  templates,  Most  of  the  warfighters  belie^d  the  process  was  easy  and  straightforward,  although  some 
complained  that  it  took  two  to  five  minutes  to  transfer  asset  data 
from  the  HHR  to  the  RP  tag. 

MOP  1.13.1  HHR  creation  of  new  RF  tags 

At  each  demonsnanon  SLte;  the  warfighters  were  given  20  RP 
tags  to  create.  The  warfighters  were  ab]e  to  quickly  populate  the  RP  tags  with  asset  data.  Questionnaire  re¬ 
sponses  indicated  tha:  creating  a  new  RP  tag  using  an  HHR  was  acceptable  (Figure  D-26).  The  two  unaccept¬ 
able  comments  did  not  provide  any  system  improve  mem  lnformation. 


easy!” 

Mieseau  Warfighter 


Rate  the  capability  of  the  HHR  to  create  new  RF  Tags 


25 


Figure  D-26.  Questionnaire  Results?  HHR  Creation  o/New  RF  Tags:  31  of  33  respondents 
agreed  that  using  the  HHR  to  create  j?sir  RF  rags  lrtrc  acceptable. 
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MOP  1.13.2  HHR  creation  of  replacement  RF  tags 

At  each  demonstration  site.  warfighters  replaced  five  RP  fags  using  the  HHR.  Hie  warfighter  was  al\e  to 
transfer  the  asset  information  ifom  the  o]d  RP  tag  to  the  replacement  RP  tag  using  ±e  H4R.  Questionnaire 
responses  indicated  that  creating  a  replacement  RP  tag  using  an  HrIR  was  acceptable  (Tignre  D -IT*. 


Rate  the  ability  of  the  HHR  to  create 


Figure  D-27.  ITHR  Creation  of  Replacement  RF  Tags  Questionnaire  Results:  31  of  33 
respondents  agreed  that  tiring  the  HHR  to  create  replacement  RF  tags  v-as  acceptable. 


MOP  1.13.3  HHR  creation  of  barcodes 

Not  assessed.  The  capability  was  not  used  during  the  ACTD. 

MOE  2.1  Reliability'  of  ATOS  RF  tag  attachment 

This  MOE  assesses  the  RP  cag  attachment  method  used  during  the  demonstrations.  During  the  Miesau  and 
CAAA  damm^tra  nous the  RP  tags  were  no:  attached  to  the  mimition:  pallets  but  were  placed  on  the  side  or  on 
top  o:  the  munitions  pallets.  A  Limited  assessment  was  conducted  by  placing  the  RP  tag  holders  on  one  wooden 
pallet  and  one  metal  pallet.  Two  methods  were  used  to  attach  the  RP  tags  on  the  wood  and  metal  munitions 
pallets.  Hie  first  method  used  wood  screws  to  attach  the  tag  holder,  while  the  second  method  used  a  special 
double-sided  adhesive  tape.  The  adhesive  tape  was  very  effective  on  meta]  pallets.  Although  the  adhesive  tape 
was  used  on  a  wooden  pallet,  the  warfighters  recommended  that  wood  screws  he  used  to  secure  the  tag  holder. 
TECEVAL  data  revealed  that  the  RP  tag  could  be  easily  separated  from  die  tag  holder  if  a  mass  of  790  grams 
was  placed  on  top  of  the  RP  tag.  A  similar  shear  force  from  either  side  or  the  bottom  also  would  cause  ±e  RP  tag 
to  separate  from  the  holder.  Although  the  RP  tags  remained  in  place  during  the  demonstrations,  one  warfighter 
stated.  £LTh,e  RF  tags  needed  a  magnetic  interface  to  pur  up  a  Rag  when  RF  tag  t  removed  from  tag  holder. 
This  would  eliminate  questionable  mcTrar. '! 

MOP  2.1.1  Reliability  of  attachment  method 

Insufficient  data  were  collected  to  assess  the  reliability  of  the  attachment  method  used  to  attach  the  tag  bolder  to 
±emnmtions  pallet  during  transport. 

MOP  2.1.2  Reliability  of  RF  tag  attachment 

Insufficient  data  were  collected  to  assess  the  reliability  of  the  RP  tag  remaining  attached  to  the  tag  holder  during 
transport. 
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MOP  2.1.3  Operator  ass  ess  men  1  of  RF  tag  attachment  and  attachment 
method 

Questionnaire  response;:  indicated  tag  attachment  and  attachment  methods  were  acceptable,  but  needed  same 
improvement  (Figure  D-28).  One  USS  Harry  3.  Truman  warfighter  fel:  the  RF  tag  holder  should  be  made  out 
of  the  pallet  material  :o  improve  durability.  Tnree  CAAA  warfighters  did  not  like  the  idea  of  using  adhesive  tape 
to  attach  the  RF  tag  holders  :o  a  wooden  bos  or  munitions  pallets.  Warfighters  strongly  recommended  using;  wood 
screws  to  secure  the  RF  tag  holders  to  the  wooden  box  or  pallets  to  prevent  the  tag  holder  from  being  pulled  off 
during  transport. 


Rate  the  acceptability  of  the  RF  Tag  attachments 


25 


Completely  _ajgely  Somewhat  Somewhat  Largely  Completely 

Unacceptable  Unacceptable  Unacceptable  Acceptable  Acceptable  Acceptable 


Figure  D-2S.  Qucsrionnaire  Resuili,  RF  Tag  Aitackmenl  and  Atrach?fiettl  Method:  22  of  2d 
respondents,  agreed  that  the  RF  tag  attachment  and  attachment  method  were  acceptable. 

MOE  2.2  Usability  of  ATOS  HHR  and  RCU _ 

This  MOE  assesses  the  usability  of  the  HHR  display  HHR.  data  entry;  HHR  docking  station  capability  and  the 
RCU-PP  bridging  using  the  Ethernet  connecti  on  Tne  warfighters  felt  the  HHR.  and  RCU  were  easy  to  use  and 
operate,  and  a  time-saver  for  managing  the  movement  and  shipment  of  munitions  pallets.  One  hhesau  warfighter 
stated  that.  ''Once  the  HHR  is  fixed,  rta  HHR  should  be  highly  usable  and  user  friendly."  An  operator 
stated.  "Display  n  user  friendly. '  The  warfighters  were  able  to  download  a  partial  inventor/  ids:  of  20  to  60  RF 
tags  from  the  PP  so  tne  HHR.  Tne  HHR  was  taken  to  die  magazine  or  storage  location  to  conduct  tne  inventory 
and  identified  new  cr  missing  tagged  pallets  within  1 5  minutes.  During  the  demonstrations.  "he  asses  sment  team 
observed  one  data  transfer  problem  with  the  HER-RCU  bridging  capability  and  two  data  transfer  problems  with. 
he  HHR-PF  bndgmg  capability  involving  transmission  of  200+  RF  tag  data  records.  The  HHE.-RCU  bridgmg 
was  resolved  by  a  software  fix  and  demonstrated  at  CAAA.  The  HHR-PP  data  Tansfer  problem  occurred 
during  the  maritime  demonstration.  This  problem  raised  some  concerns  about  accuracy  of  tne  inventory  hst 
during  the  data  transfer  process.  Tne  warfighters  also  expressed  some  concerns  about  he  HHR  processing  time 
for  reading  and  waiting  data  to  he  RF  tags.  All  warfighters  feri  it  took  a  long  tune  to  process  an  RF  tag. 
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MOP  3.2.J  HHR  display  usability 

The  warfighters  felt  the  HER  display  was  user  friendly  and  easy  to  use  (Tigure  B-19). 


Rate  the  usability  of  the  HHR  display 


Figure  D-29.  Questionnaire  Results?  Usability  of  the  HHR  Display:  All  respon  rfe?\  ts  agreed f  that 
the  HHR  display  was  ns  obis 


D-30 
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MOP  2.2.2  HHR  input  usability1 

The  warfighters  crated  the  HHR.  data  entry  was  easy  (Figure  D-30).  Reference  MOP  1.12.1  for  the  results. 


Rate  the  HHR  data  input  usability 


25 


E  20, 


Completely  Largely  Somewhat  Largely  Completely 

Unusable  Unusable  Unusable  Usable  Usable  Usable 


Figure  B-j$.  Questionnaire  Results,  Usability  of  I  he  HHR  Bata  Input:  ,-i  ll  the  respondeti  ts 
a ere-zd  about  the  usability  of  the  HHR  to  input  data. 
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MOP  2  2-3  HHR-RCU  bridge  usability 
(Ethernet  connection) 

After  fhe  TM  fixed  die  software  bugs .  die  HHR  and  RCU  bridge 
worked  well  in  transferring  data  frcm  die  RCU  to  die  HHR 
during  die  CAAA  demonstrRdon.  Hie  questionnaire  responses 
indicated  die  HHR-RCU  bridge  was  usable  to  support  niinn- 
dons  managanent  (Figure  31).  Hie  unusable  ecmments  came  from  trie  Miseau  demonstration.  These  com¬ 
ments  did  not  provide  any  system  improvement  information. 


'  "Need  to  be  a  bis  to  view  RCU  download 
at  building  by  RF  tag  ID  number,  DODIC 
and  NSN.  n 

Crane  Warfighter 


Rate  the  usability  of  the  HHR-RCU  bridge 


25 


Figiue  B-31.  Questionnaire  Results,  Usability  of  Fie  HHR-RCU  Bridge:  2  2  of  24  respondents 
agreed  that  the  HHK-RCU  bridge  was  ticabie. 
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MOP  2.2.4  HHR-PP  bridge  usability 

The  assessment  team  observed  data  transfer  problems  with  the  HHR-PP  badge  Duong  the  maritime  demon¬ 
stration.  the  HKR  transferred  all  the  Uuasacrion  records  to  the  PP  during  pallet  receipt,  but  the  PP  did  not  transfer 
the  inventory  list  of  200  PJ  tags  to  the  EHP..  During  the  Vhesau  sad  CAAA  demonstrations,  "he  HHR  and  PP 
were  successful  m  downloading  data  from  20  to  60  RP  tags.  Questionnaire  responses  indicated  the  HHR-PP 
bridge  was  usable  (Figure  D-32). 


Rate  the  usability  of  the  HHR-PP  bridge 


25 


Figure  D-32.  Questionnaire  Results  Usability  of  the  HHR-PP  Bridge:  All  respondents  agreed 
that  the  HHR-PP  bridge  was  usable 


Advance d  Technology  Ordnance  Surveillance  Final  Report  D-33 

For  Official  Use  OnEy 


153 


MOP  2.2.5  HHR-PP  docking  station  usability 

Warfighters  were  able  to  dock  the  HER  and  transfer  the  RF  tag  data  to  the  PP  when  AIDS  did  not  enccnnter 
data  transfer  problems  (Figure  D-33). 


Rate  the  usability  of  the  HHR-PP  docking  station 


Tigure  B-33.  Questionnaire  Results,  Usability  of  the  HHR-PP  Rocking  Station  -  All  respondents 
agreed  ihot  the  HHR-PP  do  rking  station  was  usable. 
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MOE  2.3  Usability  of  ATOS  PP 


Hii-i  MOE  assesses  the  PP  display  and  ease  of  data  entry.  The  warfighters  indicated  the  PP  was  easy  to  learn 
and  operate  aad  had  user- friendly  menus. 

MOP  2.3.1  PP  display  usability 

Tlie  warfighters  indicated  the  P?  display  was  easvtouse  to  obtain  inventory  and  transaction  infoitiiation  (Fignre 

D-14) 


Figure  B-34.  Questionnaire  Results ,  Usability  of  the  PP  Display:  All  respondents  agreed  ikat 
the  PP  display  hhj  usable. 
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MOP  2.3.2  PP  input  usability 

The  warfighters  seated  that  data  entry  input  using  'he  PP  was  easy  and  had  user-friendly  menus  (Figure  D-35). 


25 


Completely  Largely  Somewhat  Somewhat  Largely  Completely 

Unusable  Unusable  Unusable  Usable  Usable  Usable 


FigNt  e  D-35.  Qiiesticmnaire  Result^  Usability  of  the  PP  Dara  Entry.-  All  respondents  agreed  that 
using  me  PP  teas  usable  10  input  data. 

This  MOE  assesses  the  operators'  abiuty  so  easily  configure  the  PJ  tags,  HHR..  RCU.  and  PP  during  she  dernon- 
stradon.  AT 05.  components,  were  easy  to  configure  and  could  be  adjusted  quickly  to  meet  the  warfighter's 
needs.  One  warfighter  stated.  '  [He]  had  no  problem  configuring  RF  tags. Another  waifighser  stated.  Trie' 
HHR  and  Hie  PP  h^b  sets}.'  to  Isatw  and  have  user-friendly  software  interfaces  "  Although  most  comments, 
were  positive  about  ATOS  components.,  the  assessment  ream  received  several  c  ommeurs  about  potential  im¬ 
provements.  A  Mies.au  warfighter  stated  the  RF  mgs  need  to  be  reusable. '  '  Due  to  the  cost  of  making  the  RF 
fag.  the  warfighter  wanted  recyclable  RF  tags.  Another  CAAA  warfighter  felt  the  RF  tags  should  have  the 
capability  :o  read  a  134S  barcode  (inventory  sheet).  The  warfighter  can  print  a  barcode  and  write  directly  to  the 
RF  tag  tiring  an  HHR. 


D--3£  Advanced  Technology  Ordnance  Surveillance  Finai  Report 


For  Official  Use  Only 


156 


MOP  2.4.1  Capability  to  configure  RF  rag  r  .  .* 

It  was  mal  simple 

The  warfighters  were  able  to  nse  the  HHRto  configure  the  RF 
tag1:  by  entering  as^et  infonnadon  and  adjusting  u;:er-selectable 
emdromnennl  ie-nug^  (Figure  D-36).  Ibe  unacceptable  com¬ 
ment  did  not  provide  any  system  improvement  information.  Ibe  unacceptable  comment  did  not  provide  any 
system  improvement  regarding  the  configuration  of  tbe  RF  tags. 


Rate  the  acceptability  of  configuring  RF  Tags 


Figure  D-36.  Queitioiifiaire  Configuring  RF  Tag:  62  of  61  rscpondenta  agreed  ikat 

configuring  ihe  RF  lag  it  or  acceptable. 
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MOP  _  4 .  -  C apahi i  f h  to  con  ft  git  rs  HU-\  "fen.'  easy  10  use  and  configure" 
III?  warfighters  were  abie  to  quickly  configure  the  HHR.  to  lmk  ^ 

with  die  PP  [Figure  D-57).  The  unacceptable  comment  did  not 
provide  any  system  improvement  informs  ticn. 


Rate  the  acceptability  of  configuring  the  HHR 
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Completely  Largely  Somewhat  kamfwh^L  Largely  Completely 

Unacceptable  Unacceptable  Unacceptable  Acceptable  Acceptable  Acceptable 


To  accommodais  lie  z re*ler  "lumbe-  cl  reipcnises,  ‘he  jrasr  t:a  e  was,  Inc? ta tel 


F igur £  D-j  ~.  Questionnaire  Results,  Configuring  HHR:  61  of  62  respondents  agreed  Thai 
configuring  the  HHR  was  acceptable 


MOP  2.4.3  Capability  to  configure  RCU 

The  assessment  team  did  not  observe  the  ATOS  operators  making  any  configuration  changes  to  the  RCU. 

MOP  2.4.4  Capability  to  configure  PP 

The  assessment  team  did  not  observe  the  ATOS  operators  making  any  configuration  changes  to  the  PP. 

MQE  2.5  Adequacy  of  ATOS  training 

Tins  MOE  assesses  tbe  training  received  at  the  demonstration  sites.  The  warfighters  agreed  naming  was 
adequate  after  using  ATO  S.  Tbe  training  was  effective  in  showing  the  warfighters  how  to  operate  the  system. 
One  warfighter  state!  “iminiiag  was  Excellent  but  could  be  a  bit  mors  structured.  By  more  visual  aids  fi.s 
attach  a  tag  to  a  paRetfbm  and  go  through  a  pallet  transfer  and  pallet  issue  J.  '  All  w  arfighters  wanted  an 
ATOS  user's  guide  and  training  manual  to  explain  the  system  operation. 
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MOP  2.5.1  Training  for  RF  tag 

Training  was  adequate  :o  show  die  AT  05  pariapauvS  how  to  use  die  RF  tag  (Figure  D-JS). 


Rate  the  effectiveness  ef  RF  Tag  training 


35 


30 


Completely  Largely  Somewhat  Somewhat  Largely  Completely 

Ineffective  Ineffective  Ineffective  Effective  Effective  Effective 


Figure-  D-j&.  Questionnaire  Results^  RF  Tag  Training:  All  respondents  agreed  that  the  RF 
Training  watr  affective. 

MOP  2  5. 2  Training  for  HHR 

Training  was  adequate  :o  show  the  ATOS  participants  how  to  use  die  HER  (Figure  B-39).  The  ineffective 
comment  was  focused  on  the  [mount  of  material  presented  dicing  tbe  training. 


Rate  the  effectiveness  of  HHR  training 


Figure  B-39.  Questionnaire  Results.  HHR  Trainings  55  of  56  respondents  agreed  the  HHR 
training  was  effective. 
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MOP  2.5.3  Training  for  RCU 

Training  was  adequate  :o  show  die  AT  OS  participants  how  to  uie  die  RCU  (Figure  D-40).  Tlie  ineffective 
comment  was  focused  on  the  amount  of  material  presented  during  the  training. 


Rale  the  effectiveness  of  RCU  training 


fijn™  D^*0.  Questionnaire  Results s  RCU  Training:  50  of  51  respondents  agreed  the  RCU 
training  was  effective. 

MOP  2.5.4  Training  for  PP 

Training  was  adequate  to  show  the  ATOS  participant!  how  :o  use  the  PP  (Figure  D-41j. 


Rate  the  effectiveness  of  PP  training 


Completely  Largely  Somewhat  Somewhat  Largely  Completely 

Infective  Ineffective  Ineffective  Effective  Effective  Effective 

n-icnpirauanlc  :hc  gre-atcr  mir^r  of  responses  :ht  grim  sen  s  Ip:  reused 


Figure  D-4I.  Questionnaire  Results,  PF  Tr  aining:  All  respondents  agreed  that  the  PP  framing 
li'-aj  ejffeciive. 
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MOP  2.5.5  Effectiveness  ofATOS  training  material 

Tlie  warfighters  felt  the  training  was  effective  m  prDvidtng  the  necessary  information  to  operate  the  AIDS 
system  dining  the  demonstfatknts  (Fifure  D-42).  Hie  iaeffecdve  comment  did  net  provide  any  iofonnarion  on 
improving  tbe  trainuig. 


Rate  the  effectiveness  of  the  ATDS  training  material 


Figure  D-42.  Questionnaire  Result?,  ATOS  Training  Material:  55  of  56  respondents  agreed  the 
ATOS  training  malarial  was  effective. 

MOE^JJAdecjiiarvjif^TQS^CQmjjjQiieinruggediies^^^^^^^^^^ 

This  MOE  assesses  tbe  mggedness  of  tiie  EJ  tags.  RCU.  and  HER  in  an  operadcnal  environment  Tbe  assess¬ 
ment  of  tbe  A! OS  component  tuggedness  was  limited;  however.  TECEYAL  data  revealed  tbe  RE  tags  me:  the 
mggedness  requirements  stipulated  in  die  FRD.  .All  RE  tags  performed  aommally  except  fo:  two  inoperable  RE 
tags  (cause  unknown).  Hie  assessment  team  did  not  observe  any  HHR  failures  due  ic  handling  by  the  warfighters; 
however,  the  assessment  team  observed  tbe  HHRs  lock  up  on  occ  asion  and  seeded  to  be  ret  coted.  Hie 
assessment  team  also  observed  two  RCU  failures.  Dae  failure  was  due  to  a  faulty  flash  memory  card  and  the 
second  failure  was  due  to  a  bad  power  supply.  With  the  exception  of  the  data  transfer  problems  with  tbe  HHR 
and  PR  ATOS  performed  nominally  dining  the  demonstration. 

MOP  2.6.1  RF  tag  ruggedness 

TECEYAL  data  revealed  tbe  RF  tags  met  the  mggedness  requirements  stipulated  m  tbe  FED.  Hie  PE  tags  can 
operate  between  -20':F  and  -1 55':'E  and  between  OY  and  95'-'--.  relative  humidity  (non-condensing).  Hue  RE  tags 
functioned  after  a  15  kilovolt  electrostatic  discharge  test  and  4-fo-oi  drop  onto  concrete.  Hie  RF  tags  operated  for 
10  days  at  the  Miesau  and  CAAA  demonstrations  where  they  were  placed  outdoors.  RE  tags  were  functional 
when  they  were  shipped  from  CAAA  to  Norfolk  Naval  Station  via  commercial  ground  transportation. 

MOP  2.6  2  HHR  mggedness 

TECEYAL  data  revealed  the  HHR  met  tbe  mggedness  requirements  stipulated  in  the  FRD.  Hie  assessment 
team  observed  no  HHR  failures  during  the  demonstrations. 

MOP  2.6  3  RCU  mggedness 

TECEYAL  data  revealed  that  tbe  RCU  met  the  mggedness  requirements  stipulated  in  the  FRD.  Hie  assessment 
team  observed  two  RCU  failures  during  the  demonstrations.  The  cause  for  tbe  failures  bas  not  teen  determined. 
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MOE^^uj)|)ortnbilitv_Gf^TOSj>QTverretjiiimnent^^^^^^^^_ 

Tons  MOE  assesses  die  power  recfiiirements  for  the  RP  Tag5:.  HHR.  RCU.  rndPR  Tlie  assessment  team  observed  no 
major  is sites with providing  electrical  power  :o  support ATOS  components  during tlie  demonstrations.  Some  CAAA 
users  felt  that  providing  electrical  power  to  remote  storage  magazines  or  facilities  could  be  a  challenge.  However.  24 
VDC  batoenes  or  gas-powered  electric  generator  could  be  used  to  support  power  needs  at  these  remore  sites. 

MOP  2. 7.1  Voltage  for  RF  tag  operation 

No  RP  tags  were  replaced  due  :o  low  battery  power  indication  during  tbe  demonstrations. 

MOP  2.7.2  Voltage  for  HHR  operation 

Tbe  HHR  used  wvo  rechargeable  bav-enes  and  docking  stations  :o  ensure  pow  er  was  maintained  Tne  assessment 
:eam  did  not  observe  any  power  issues  with  the  HHR. 

MOP  2. 7.3  Voltage  for  RCU  operation 

As  long  as  the  RCU  was  ab*e  to  obtain  24  VDC'.  die  RCU  was  able  to  operate  without  any  problems. 

MOP  2. 7.4  Voltage  for  PP  operation 

Tbe  PP  was  hosted  ob  a  commercial  laptop  computer.  As  lobg  as  120/22D  VAC  power  was  available,  the  PP 
continued  to  work. 


MOP  2. 7.5  Detection  of  npe  of  electrical  input  power  to  RCU 

Durmg  the  demons-ration.  the  24  VDC  power  source  came  horn  a  portable  gas  electric  generator.  High  Mobility 
Muldpurpose  Wheeled  Vehicle  battery  or  1 20  VAC  line  power  using  a  24  TOC  step  down  transformer. 

MOP  2.7.6  Operator/SME  assessment  of  RF  rag  power  requirements 

Tbe  Miesau  munitions  SME  indicated  the  RF  tag  batteries  should 
be  replaceable  instead  of  throwing  away  the  RP  rag.  The  warfighter 
warned  :o  see  a  visual  indicator  on  the  outside  of  tlieRP  tag  casing 
so  display  battery  strength  Questionnaire  responses  indie ated  the 
RP  sag  power  requirement  was  acceptable  during  the  demonsra- 
don  (Figure  D-43).  Tne  unacceptable  comments  focused  on  the 
designing  of  the  RF  tags  so  that  tiie  operator  can  replace  the  batteries. 


"Need  to  adopt  a  way  io  change  om  the 
batteries  J: 

Warfighter 


Hate  the  acceptability  of  HP  Tag  power  requirements 


35, 


3  28 
lA 

c 

Q  11 
Cl  21 


14 


u.'  _ 

Jb  7 


Z  0 


Canplc^c-y  L^rtjely  Somewhat 

Unacceptable  Unacceptable  Unacceptable 


Largely 

Acceptable 


Complrtely 

Acceptable 


Ti  a:zcTi-3da:c  :he  jrcaier  number  or  responses  iht  3^ap-i  ica  Inreased 

Figure  D-43.  Questionnaire  Results;  RF  Tag  Power  Requirements:  5J  of  IP  respondents 
agreed  shat  the  RF  Sag  power  requirements  were  acceptable. 
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MOP  2.7.7  Operator/ SME  assessment  of  power  requirements  for  HHR 
and  RCU 

The  CAAA  warfighter  indicated  power  availnbility  at  remote  storage  locations  would  be  a  major  concern  Many 
of  these  magazines  will  not  have  electrical  power  to  support  die  HHR  and  RCU  power  requirement';..  Question¬ 
naire  responses  indicated  die  HHR  said  RCU  power  requirements  were  acceptable  during  ±e  demonstrations 
■;  Figure  D-44).  Toe  unacceptable  comment  did  not  provide  any  information  to  improve  the  power  requirement. 


Rate  the  acceptability  of  HHR  and  RCU 
power  requirements 


25 


S  20- 


■^i 

c 


Completely  Largely  Somewhat  Somewhar  Largely  Completely 

Unaoieptable  Unacceptable  Unacceptable  Acceptable  Acceptable  Acceptable 


Figure  D-44  Questionnaire  Results.  HHR  and  RCU  Power  Requirements:  22  of  23  respondents 
agreed  the  HHR  and  RCU  power  requirements  were  acceptable. 
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MOP  2.7.S  Opera tor/SME  assessment  of  PP  power  requirements 

The  warfighters  indicated  the  PP  power  requirements  w ere  straightforward  aad  easy  to  accomplish  as  long  as 
■Jbe  PP  was  hosted  in  a  facility  that  had  1 20/220  VAC  dectncal  pokier  (Figure  D-4S). 


Figure  D-43.  Questionnaire  Results,  PP  Power  Requirements:  All  respondents  agreed  that  the 
PP  power  requirements  were  accep  table. 
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Tlii1]  MOE  assesses  the  installation  of  ATOS  components .  The  installation  at  all  the  demonstration  sues  was 
quick  and  easy  as  Ion?  as  there  was  a  place  to  hang  the  RCU  and  RFEs  and  there  was  a  120O4G  VAC  power 
source  for  the  RCU  and  RFEs. 

MOP  2.S.J  Operator/ SME  assessment  of  RCU  installation 

The  warfighters  indicated  the  location  and  accessibility  of  the  RCU  were  acceptable  for  the  demonstrations  as 
lone  as  there  was  a  place  to  liana  the  RCU  and  RFEs  [Figure  D-46)  Tie  wraps  were  used  :o  install  the  RFEs 
and  the  RCUs  were  mounted  on  portable  stands  or  a  table.  The  unacceptable  comment  did  not  provide  any 
information  that  would  improve  the  RCU  installation. 


Rate  the  acceptability  of  RCU  installation 


25 


Figure  D-46.  Questionnaire  Results,  RCU Installati&n:  36  of  3?  r  espondents  agreed  that  ihe 
RCU  installation  waj  acc&piabls. 
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MOP  2.8. 2 

Hie  warfighter  indicated  tbe  PP  instellaJtion  was  straightforward  since  tbe  software  ls  hooted  on  a  laptop.  The 
que&tioaaaiie  responses  indicated  tbe  PP  installation  was  acceptable  dining  the  demoiisTatLon  (Figure  D-4T). 


Rate  the  acceptability  of  the  PP  installation 


Figure  D-47.  Questionnaire  Results,  PP  Installation:  _M  raspottdanls  agreed  the  PP  installation 
v:as  acceptable. 


D-46  Advanced  Technology  Ordnance  Surveillance  Final  Report 

For  Official  Use  Only 


166 


Appendix _ 

Correlation  of 


USEUCOM  Functional 


Requirements  Document 
to  Me  asures  of  Performance 


Results 
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A&  requested  by  USEUCOM.  th®  appendix  correlates  FFLD  requirements  assessment  results,  and  MOP?. 


Requirements 

Results 

MOP 

D  a  f  a  Fag 

1 .1  Alla  c  lima  nfl.  The  RF  toy  will  he  inserted 
into  a.  holder,  which  wil  tie  securely  affathed 
t  t ie  pdlel  u  ccrriarier. 

Curing  fie  demons  Ira  tores  bofi  R  Flaps  and  Ijy  holders 
remained  tUMhadblhflMdbup«H&.  Ttie  warfijfiters 
irdica led  llie  RF  tay  dfladirntJil  and  atfachrnerri  rnefiOd  used 
on  the  rnefal  containers  worked  wdl. 

2Lt1 

2.13 

1 .1.1  Tag  hdder  rfluSl  Se  curdy  attach  Id 
ccrnnon  anrnunitcn  puckayiriy  materials 
■such  as  mod,  laminates .  Sled ,  aluntaum, 
tber^ass  arrJ  piastres. 

Al  02  RF  fays  performed  asdedyned.  Cne  RF  fay  holder  came 
off  a  mutilans  pallei  during  Ihe  marilme  demon  stalon . 

Curing  tie  Msaiu  arid  Ottnedernofista  lores,  boti  R  Flips  and 
fay  hddersrerrfairfad  atliitfied  lO  tie  rnefal  muniicres  palefa. 

Ttie  warf] 5^1  ters  indicated  Ihe  RFldg  atfachrnerri  arid  alfadirneril 
method  used  on  the  metal  conrfaherswerked  well.  WarfijJrto-s 
storiyfy  recommended  uairp  wooden  screws  lo  secure  ihe  R  F 
fay  tiddera  lo  tie  wooden  bo*  or  pallets  lo  prevent  tie  RF  fay 
holder  tom  beirp  polled  offdurtiy  tnmwrt 

2:.t2 

£.t3 

1 .12  Tag  hdder  musl  facilitate  aisy  RF  try 
removal/  rcpl IdCfmrt  and  (an  Survive  typical 
handling  aid  tmOMMon. 

32  R  F  l,x|  h  were  dipped  tOrnCAAAIo  Mcrfclk  Moral  -5 1  aid i or i . 

2..  1.2 

2.13 

1  2  Tag  Maimory .  The  RFIa^j  will  h a&rb 

SufitM  ncjivolatle  memory  Id  sfcre  dll  toy 
data  items 

Ttie  wadi ^i las  indicated  Ihe  RFldg  cfata  starve  wan  adequate 
far  Sluing  annel  cfid  erivircrrnental  data  durrig  Ifie 
demonstalon . 

i.af 

1 .3  Tag3crrac.rs.Trie  dernanStalon  RF  tay 

will  Contain  Iwo  Hen  sura ,  lernpera  Ure  and 
relative  tumidity,  witi  ports  to  Support  two 
oddiicrial  sensurs  for  future  expansion .  Up  to 

20  RF  fags  will  ccfilari  a  sliccA  SeriSOr  to  tie 
used  in  parallel  tesliig  and  evaluaton  al 
MAY-SEA.,  fadian  Head  MD f«  pcrcsLIe  IUU» 
RF  tay  applicatori. 

The  terrpertfare  SerlSOT  was  accurate  wit lin  1  l*F. 

TTie  lofal  of  4QG  RF  fags  were  used  during  the  demonstalons. 

2QQ  RF  fays  wa-e  used  oonslarily  to  sippoH  all  the 
demonstalons.  Mosl  of  tiese  RF  fay^s  w*re  iriilalized  in  Wardi 
2GG4  {approjdrnately  A  70G  fiourH  opera  Iriy  lime}.  The 
asse^snenl  tein  did  riol  obsert*;  arly  failLfeS  ri  tie  terrperatare 
neresor  and  reladivehumidly  sensors. 

Ttie  RH  sensor  was  accurate  witiin  l  1:0%. 

The  RF  lay  can  record  and  slcre  fer  45  days  (1050  dafa  perils} 
of  environmental  dafa. 

The  RFlay  oolleoled  and  recorded  lempenalure  and  relalve 
humidity  cfata  every  6G  rri males .  Confirm  by  nsviewiny  tie 
tistognamdafa. 

Duririy  tie  dernorBtalorB ,  Ihe  TM  randomly  Selecled  tie  hiytl 
if  id  low  user-'neleofable  lernpwa  tare  and  RH  limits .  k4ary  of 
tiese  sefliriys  were  not  qperaf  anally  representadive.  AJtiouyh 
tieiPPwas  a  tie  to  display  tipped  fla^s.  tie  assessment  learn 
dd  not  know  fiow  many  RF  fays  wee  used  to  demonstrate  this 
capability. 

Curing  tie  demorfi VatOrS ,  bo ti  R  F  ti^s  and  1  aip  holders 
remained  adfaofied  10  the  rliunilons  pallets.  Tfie  warfi^iters 
indicated  Ihe  RFfay  atlacfimenl  and  atfaJirnerri  rnetiod  used 
on  the  rnefal  Containers  worked  wdl .  However,  warfyhters  were 
concerned  about  rneasuriny  tie  tempered  ere  and  RH  inside  the 
individual  muiitonscontairiers.  Recommend  RFtays  be  piaced 
inside  ifiese  containers  ratier  tiari  on  tie  munHioris  pallefa . 

WTten  availatie,  enVirorimerrial  sanson  ahodd  be  errtiedded  in 
individual  mutifons. 

1.2.2 

1.23 

1.2.4 

1.25 

1.28 

1.29 

1.2.  m 

1.211 

1.212 

1.213 

1.214 

1 .4  -Shock  5a nrsor.  The  shock  Seres  cr  wil 

consisl  of  nOri-resettaUe  hfU  switches  witi 
iridvidually  preset  Shock  tireshcJds.  There 
■diall  be  two  shack  measures  on  each  of  ihe 
jc-,  y»,  and  z-aices .  in  tie  even!  of  tie  tay 
ejperiendng  a  diode  ri  hou  of  a  sensor 
tirediOld.  a  data  lag  resdeil  HftAft  RF  fag 
will  be  ne  1 1o  indicate  I  lie  event. 

Mol  assessed. 

1.2® 

1.218 

1.217 

1.2  m 

1.219 

1.228 

1  .4.1  TTie  UiftHk  far  shock  tireahold 
enoessitfi  lla^js  bdny  incorrectly  set,  or  not 
sa^  diall  be  no  greater  lhan  5% . 

Mol  assessed. 

1.2® 

1.2® 

1.2® 

1.2® 

1.228 
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Requirements  Results  MOP 

Data  Tag 


1.5  T«i  mp4  flSluf  4  -54 II  fi*i  4  ltd  RF  Tati  M4irt*iy  ■ 

The  Rf  lag  will  lally  tenperalure  ranges 
experienced.  Tenperalure  tellies  will  be 
maintained  in  an  array  al  memory  bins 
correlafng  lo  blocks.  Memory  capacity  per 

memory  bin  snail  be  aulfdem  to  hdd  all 
indvidud  lailies. 

The  warfghlerindcated  tee  RFtag  date  storage  was  adequate 
during  demonstrafons. 

1.9.4 

1.5. 1  Temp  era  to  re  sensors  shdl  be  accurate  te 
±5-  IF. 

Temperalure  sensor  was  accurate  witein  ±  1*F. 

122 

1.52  Told  lenperatore  lally  date  loss  due  1c 

lerr^eralure  sensor  teiure  shall  nol  exceed  5%. 

The  assessment  team  observed  no  tenures  in  tee  tenperalure 
sensor. 

122 

122;! 

1 .6  Relative  H  u  ink!  ity  Sa IHf  4  ltd  RF  Tay 

Mamwy.  The  Rf  teg  will  lally  RH  ranges 
experienced.  RH  lailies  will  be  mainrisined  in  an 
array  ol  memory  bins  oometefng  to  5%  RH 
blocks.  Memory  capacity  per  memory  bin  shall 
be  sulfciem  lo  hdd  al  individual  lailies. 

The  warfghlerindcated  tee  RFtag  date  storage  was  adequate 
during  Ihe  demonstrations. 

1.94 

1  6. 1  RH  sensors  shall  be  ascLrana  lot  5%RH. 

RH  sensor  was  accurate  witein  ±10%. 

12J 

1.6.2  Total  RH  tely  date  loss  due  lo  Hi  sensor 
lailura  Ehidl  nol  exceed  5%. 

The  assessment  team  observed  no  tenures  in  tee  RH  sensor. 

12j5 

1223 

1.7  T4  mp4  rain  re  Tlwesltcld  Irtdi44l.crs.  The 
RF  teg  wil  have  separate  date  demente  to 
acconYKVodate  high  and  lew  tenperalure  tab. 

A  bl  lag  or  indcater  associated  Wto  exceeding 
a  given  high  or  low  tenperalure  linrtfl  will  be  sel 
upon  deleclion  ollhal  lenperatore. 

Curing  tee  demonslrafons,  tee  TM  randomly  sdected  tee  high 
and  low  user-selectehle  lenperatore  imits.  Many  olteese 
setfngs  were  nol  operationally  representafve.  Although  tee  FP 
was  able  te  display  iripped  lags,  ihe  assessment  team  did  ml 
know  how  many  RF  tegs  were  used  te  demonstrate  IMS 
capabiily  and  tee  TM  did  nol  record  tee  number  ol  RF  tegs  teal 
had  teeir  tenperalure  selfngs  changed. 

12.9 

till 

l2_l£ 

121-1  7 

1.7.1  The  teilure  rale  lor  tenperalure  uis  on  a 
single  RF  teg  nol  being  sel  upon  tee  deleclion 
ol  tteir  tenperalure  shall  be  5%. 

The  warfghlerindcated  changing  tee  RFtag  user-selectahle 
tenperalure  limilswere  easy  lo  team  and  operate  tee  HHlR. 
TECEVALdala  showed  20  RF  lags  had  tedrhigfi  am  low 
tenperalure  limits  sel.  Al  20  tegs  had  their  environment  llags 
Iripped  al  tee  appropriate  limil  setfngs. 

The  assessment  team  observed  no  teilure  in  teelenperalure 
sensor. 

120 

1220 

1  .a  RH  TltrasHold  1  rwficalws .  The  RF  lag 
will  have  separate  dala  dements  te 
accommodate  ter  high  and  low  hurridty  linrfls, 

A  bl  lag  or  indcater  associated  wite  exceeding 
a  given  high  or  low  humidlylinril  will  besel 
upon  deleclion  ol  lhal  ralalive  hurridty l«*l- 

Curing  tee  demonslrafons,  tee  TM  randomlyselected  tee  high 
am  lowuser-setectable  RH  linvis.  Manyollhese  selfngs  were 
nol  operafonally  representafve.  Although  ihe  IPP  was  able  lo 
display  tripped  lags,  tee  assessment  learn  did  mlkmwhow 
many  RF  tegs  were  used  te  demonstrate  IMS  capability. 

The  warfghlerindcated  changing  tee  teg  user-selectable  RH 
limilswere  easy  lo  learn  on  tee  HHR. 

12_10 

12_11 

12.14 

121-17 

1  .a.  1  The  teilure  rale  tot  RH  bils  on  a  single 

RF  teg  nol  being  sel  upon  tee  deleclion  ollheir 
percentage  shal  nol  exceed  5%. 

TECEVALdala  showed  20  RF  lags  had  teeir  upper  and  lower 

RH  limits  sel.  Al  20  tegs  had  Iheir  environment  lags  lipped  al 
tee  appropriate  limil  sellings. 

12_4 

1220 

1 .9  Tau  Trail  am  tea  ten .  Once  per  hour,  Ihe 

RF  tegs  wil  be  iniliated  by  an  RCU.  Eachftf 
lag  will  iransmiteg  iD.lirrilllags,  battery  slams, 
and  any  updates  te  ihe  asseldala  and 
histogram  since  tee  previous  iransmssion. 

Altee  Miesau  demonsteslion.lhe  RCU  detected  199  oul  ol  200 

RFl^gafHLBKJkis  60'  x40  x  15'  earte -cove red  magazine 
using  teree  RFEs.  RCU  detected  109  oulol  17 4  tags  (67.1%)  ii 
a  70  x20tf  ASP  using  dghrt  RFEs. 

Altee  Crane  demonslrafon,  RCU  detected  197  out  ol  200  tags 

4 $9 .5%J  in  holh  tee  100  x  50'  xlU  earth-covered  magazine 
using  a  RFEs  am  200'  x  50'  storage  warehouse  using  12  RFEs. 
Altee  Marifme  demo  ns  tart  ion,  HHR  detected  eo  oulol  a  0  RF 
lags  <  100%>  in  a  10'  x  22"x  a1  magazine  on  Ihe  USS  Ponce 
(RCU  was  nol  inslsHed^and  200  oul  al  200  RF  lags  in  a  45  x  80' 
x  10  on  tee  USS  Harry  S  .Truman  using  5  RFEs  and  RCU. 

"T£l 

12l10 

122 

1.9.1  The  tag  wil  "waKeup"e very  hours  10 

rrinulea.  This  teg  "wake  up"  will  be  controlled  by 
a  receiver  counter  on  board  tee  teg  and  will  be 
sel  ter  hourly  raadngs.  The  "wake  upr  interval 
will  be  accessible  ter  change  via  an  pppraprlate 
operator  interlace. 

TheTM  rcu  daia  logger  was  used  ai  Miesau  and  caaa 

dernonstalionsam  system  test  lo  monitor  tee  RCU  software 
acf^ty-  The  RCU  data  logger  documerried  Ihe  slarl  and  stop 
f  mes  ol  ihe  RCU.  The  results  indcated  teal  tie  RCU 
aulomafcaly  interrogaled  ihe  RF  tags  every  60  minutes.  When 
tea  RCll  de1eds  a  change  in  Ihe  RF  teg  assel  Ptarmalion .  Ihe 

RCili  sends  a  lag  lo  tee  PP  during  tee  muriy  inrierrogafon. 

U32L 
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19.2  ATOS  hardware  coniguralion  mu  si 
□New  fa-  iritis  coverage  (oammuniaitan 
between  RF  lag  and  render;-  n  a  magazine. 

The  anlenna  coverage  wusexci^licnal  allhe  demon  statons. 

Al  tie  hAesau  and  GAAA  demon  stators,  tie  RCU  was  able  to 
detect  al  least  9Q.5%  of  200  RF  tags  dunng  tie  irsl  interrogator! 
evde  albotn  demo  re:  tat  ore:  and  after  Ihe  Ihrd  interne  go  ten 
cyde  1 00%  of  tie  RF  ta^:  were  delected . 

Al  tie  maritime  do-nonslralion,  FtCu  was  able  la  detected  200 
ou1of20Q  RFlpg s  an  tie  L/S5  llairy  S  .Truman. 

110.1 

19l3  The  u  nob  si  fueled  readMnle  range 
between  Ihe  RF  lag  and  a  MMR  shall  be  al 
lea  si  20  feel.  The  failure  rale  shall  ncl  exceed 
3%. 

The  delecton  range  between  RF  lag  sand  tie  MMR  is 
approximately  -DO  feel .  The  MMR  will  loch  up  if  anotier  1  IMR 
c pirate  s  in  dose  prwmriy  (20  feel). 

1110 

110  Tag  FLocerver.  The  RF  lag  will  have  a 

receiver  lhal  will  allow  dala  lo  be  bcti  wnllen 
la,  and  read  ■fram.inieimH  mamcrj,  and  Io 
resend  toexlonal  cammani:  from  tie  l#fR 
aid  RGU.The  receiver  will  be  avail Jtile  everv 

3  second. 

Warfignlirs  were  able  loread  and  wnte  to  tie  RF  la^i  uang  tie 

MiR.  The  RF  lag  wa  s  able  to  Iran  sfa-  Ihe  dala  to  Ihe  MMR  and 
RCtJ.  However,  warfign  1  irs  staled  Ihe  RF  lag  read-wnle 
pnccesang  speed  need:  improvamenl. 

The  logstcs  and  mumtonsSMEs  ndioated  tial  tie  MMR  woiJd 
sometimes  have  toJnle  pideng  up  tie  RF  lag  ID  number. 

The  munitors  SMEsfdl  dnanging  tie  Ipg  user- selectable 
lomperalure  was  easy  1o lean  and  use  witi  tie  111  1R. 

The  munitors  SMEsfdl  dnanging  tie  RF  lag  user-seleclaUe 

Rll  liml  was  easv  1o  learn  and  Lse  witi  1h*  MMR, 

12.9 

12.10 

111 

113 

114 

1114 

1116 

1117 
ii  m 

1119 

1 1 1  Power  Cor  sc  rvation.  The  abilly  1c 
increase  Ihe  duraton  belwoan  crnnaided  RF 
lag  tan  am  ssen  s  can  serve  as  a  metiod  by 

tel  assessed. 

1.12  Dalle  ry  Indicator.  The  -lag  shall 
ajtnmatcdly  swilch  ovorto  abadoup  baflay 
whai  Ihe  primary  cdl  can  no  kxiga  power  Ihe 
fag.  When  tiis  occurs, a  badujp  baflay  lag 
will  be  selwhch  will  provide  Ihe  notfcalian  of 
a  dead  battery  n  need  ofaltenliai. 

20' RF  lags  switched  over  to  Iheir  badtup  baftenesand  sent 
battery  la^;  tc  Ihe  RCU  wtien  Ihe  man  cdls  fell  below  02  volts 
dunng  TECEVAL.  Dtring  tie  demorstalians.one  RF  lag 
Irananfled  a  baHeryflag. 

118 

2.7.1 

1.12.1  The  -n-J  nuntiaafiRF  :pgs fating :he 

ragjirarnai:  lis-red  in  paragraph  1 .12  ■;Socar?1 
indiGaia-;  during  :ha  sysrem  demaisTaian  shal 
no:  exceed  3%. 

htofaluresoccuTed  dunng  tie  TECEVALand  opwratond 

demon  si  rail  an  s. 

118 

2.711 

110  Tag  ID.  The  RFla^:  will  have  a  unique 

njmencal  idontfiw  an  eadn  individual  lag 
delivered  from  tie  vaidcr.  The  ID  number  mu  si 
be  human -visHe  and  barcode  readable  on  tie 
outside  of  tie  RF  lag . 

MMR  was  deagned  todiqnlay  RF  lag  tansacton  records  instead 

of  dsgaying  tie  RF  lag  ID.  The  warfignlirs  needed  1o 
do'wnload  tie  Mi R  tansacton  recant  to  tie  PP  io  displav  tie 
asagned  RF  lag  ID.  Dunng  tie  WesauandCAAA 
demon  si  rail  an  s,  Ihe  woTig  filers  -wire  able  toidentfy  20  oul  of  20 
RF  lag  s  u  sng  Ihe  MMR.  During  Ihe  manlime  domon  slraton ,  tie 
warighters  were  able  to  properly  iderrlifv  00  oul  of 60  RF  lags 
(1 00%)  by  lhar  assigned  lag  ID  numbers. 

The  warighlers  were  able  to  visually  identfy  tie  20  selected  RF 
Ipgs  by  tieir  ID  numbers  al  each  domon  slraton.  Oie  warighter 
slated,  ^ID]  numbers  (were]  readable  and  easly  localed.-1 

The  Mi  R  had  some  problems  reading  Ihe  lag  barcode.  Several 
warighters  staled,  '[The]  MMR  had  sorrie  dificulty  reading  lags 
cons  stonily.'  The  warighlers  needed  to  pace  Ihe  MiRcIme  to 
Ihe  R  F  lag  s  to  read  tie  bo'code . 

115 

118 

117 

1.13  lag  U  ra  at  lorv'li  uniting  by  HUH.  Ihe 

tperalar  will  have  tie  abilly  Io  creole,  or 
'bum “  a  new  lag  using  dala  stored  cn  a 
handheld  reader. 

1  he  wartghlors  indicated  tie  Mtl  was  easy  1o  use  1o  areale 

new  RF  lags. 

The  warighlers  were  able  to  Iran  star  RFlpg  data  from  a 
defectve  RFlag  to  tie  replacomenl  RF  lag.  Occasionally,  tie 

MMR  would  have  some  dficulty  tan  starring  Ihe  data  to  tie 
regacemonl  RFlag. 

The  warighlers  staled  tie  barcode  labds  were  easy  and  qucker 
io  inoul  a  s  sal  data  1o  tie^Flag^ 

iri.i 

113.2 

113.3 

115  Tag  Transmission.  The  RFlpg 
tarEmsaon  swill  be  wilhn  HERO  camphanl 
radiated  power  paramela-s. 

The  RF  lag  Iran  amllerpawa'  was  HI  230  mW,  wtich  mol  Ihe 
iiERO  requiremenls. 

1112 

till 
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1 . 16  Tag  F  reque  iwy .  The  RF  tegs  musl 
operate  in  tequenoesapptovabte  tor  CONUS 
and  OCONUS  haslnalcns. 

The  RF  lag  Irananlter  Tequency  is  433 .92  MHz.  RF  lags  mel  Ihe 
HERO  requiremema. 

1.3,13 

1 .17  Tag  ftuggedoeaa.  The  tegs  musl  opiate 
belween  -2CT  F  and  +1 55s  F  and  between  0% 
and  95%  relalve  humdily  frion-ocndenangj. 
The  RFlags  musl  dsobe  tperiite  altera  15 
kitovoi  elecTostelc  disOnaige  leal  and  fl-fcc-1 
dicpcmoctonaete.  Addilcnaly,  Tie  RFlaga 
mual  be  enuranmentelly  sealed  solhal 
exposure  to  ouWoor  elements  doea  not  cause 
damage  to  Ihe  lag.  The  lag  should  be  *le  lo 
sirvive  typcal  handing  and  Tanspolalion.  The 
fl-fcol  Ocp  onto-  centred  (above)  addreaaea 
shock  requirements.  ^bralon  requirements 
are  baaed  on  Tie  aommeroal  wbralcn 
speofiealcn  slpulafed  by  Ihe  manutecluer. 

The  TECEVALdala  revealed  Tie  RF  lags  mel  Tie  ruggednesa 
requirements  slpUated  in  ihe  FRO. 

The  RF  lags  can  eperale  between  -2DT  and  +155°^  and  between 
0%  and  95%  rdalrve  hundity  (non-oondenang  ).The  RF  lags  can 
function  after  a  1 5  HlowctlelecToslatic  discharge  teal  and  fl-idol 
drtp-  or to  ccnoiele. 

The  RF  lagsoperaled  tor  10  daysal  Weeau  and  CAAA 
demonstration  paced  in  Ihe  ASP.  RF  lags  remained  fund  oral 
dunng  Ihe  IransferTomCAAAloTie  Norfolk  Naval  Slalon  'via 
commeroal  ground  Tanapohalon. 

2JS.1 

HHR  \ 

2.1  HHR  Data  Transm  las  tons  and  Reception. 
The  HHRwll  Tansmilinslruclans  lo  Tie  lag  lo 
change  lag  d ala  suOn  aa  quanlly  values  or 
candilon  code  .and  will  receive  delailed  aaael 
dala  from  Tie  RF  lag. 

Al  Tie  Mseau  demonsTalon,  Tie  warlgmers  used  Tie  HHRind 
funclion  lo  locate  ive  lagged  pallets  lo  issue  mumlcns  items.  All 
ive  lagged  mumlons  panels  ware  located  uang  Tie  HHR.  The 
warfghterwas  Ate  to  execute  Tie  rotl  call  funclion  uang  Ihe 

HHR.  Ho  ma|or  problems  were  observed  dunng  Tie 
demon  slralians. 

Al  CAAA demonsTalon,  ATOS  operatorwas  aHe  looonducl  an 
invemory  of  an  earTi-oovered  magazine  wTim  20  minutes  uang 

Tie  roll  call  funclion.  The  warighlerfell  Tiis  functionality  wood  be 
a  Ime  saver  in  lie  fidd . 

Curing  Tie  mamime  demonstration,  Tie  HHR  was  effeclve 
performing  a  speedy  idly  of  63  RF  lags  nside  ihe  USS  Ponce 

10fr  22x  9  storage  facilly.  The  lask  was  completed  whin  10 
minutes. 

On  Tie  u£S  Harry  S. Truman,  Del  1  AFOTEC  performed  a  roll  call 
opa'alon  on  233  RF  tegs.  The  HHR  was  able  to  find  199  RF 
tegs  and  one  bad  lag.  The  lask  was  completed  whin  ISminules. 

1.2.9 

1.2.13 

1.3.1 

02 

02 

O A 

1.3.16 

1.3.17 
1.3.16 
1.219 

2.2  HHR  Display  and  Key  pad.  The  HHRwll 
have  a  display  lo  anew  date  received  Tom  Ihe 
lag.  Hwii  have  a  ka^pad  for  manual  enTycf 
dala  into  Tie  lag  memory,  and  a,  deplay  aoeen 
for  dala  Tom  ihe  lag.  The  k^pad  deagn  wll 
allow  Ihe  us^  to- enter  data  Wnile  weanng 
gloves.  The  use  of  a  stylus,  whicti  is  wred  to 

Ihe  HHR,  fcfka'pad  d ala  mampulalon  is 
accgmue. 

The  warighters  slated  Tie  HHR  keypad  was  easy  to  use  to  input 
assel  infaimalian.  The  warighlers  were  aHe  louse  Tie  slyius  to 
mpul  assel  imotmalian.  The  stylus  was  especidly  useful  Wnen 

Tie  warighters  woe  weanng  bulky  globes  in  Tie  Mesau 
demonstration.  Some  of  Tie  warighlas  mOcaled  Tie  stylus  was 

Tie  quidcesl  way  of  mpullng  dnanges  lo  Tie  asset  date .  Meal  of 

Tie  warighters  Ihcughl  Ihe  HHR  dsptay  was  user-Tiendlyand 
easy  lo  use .  The  wa'fi^nters  indicated  ihe  H  HR  date  enTy  was 

1.121 

1.122 

22.1 

222 

23  New  Tag  and  Barcode  Creation.  The 
HHRwll  be  able  lo create  a  new  lag  in  a  field 
environmanl.  There  wll  be  Tiree  meTiods  to 
create  RF  lag  -  (1 }  by  use  of  Tie  HHR  keypad; 
(2)  from  oomainer  barcodes;  {3)  Tom  ihe  PP 
dala  lhal  is  stored  on  Tie  HHR. 

The  warighters  steted  Tie  HHR  was  easy  to  use  to  create  new  RF 
tegs.  The  warigmers  were  aHe  transfer  RFteg  date  from  a 
defeclve  RF  lag  to  ihe  replacement  RF  teg.  Oocaaonally,  ihe 

HHR  would  have  some  difioulty  Tansfemng  Tie  data  to  Ihe 
replacement  RFlag.  The  warighlas  fell  uang  Tie  bioode  labels 
was  Tie  easiesland  quckesl  wayofirpulling  asset  date  loTie  RF 
teg. 

1.13.1 

1.132 

1.13.3 
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2  A  M  M  R  to  PP  1  liter  face .  Tha  HHR  Wil 
communicate  Wlh  tie-  P  P  by  means  *1  a 
■J i  rec  1  c  onme ct c ri  ■: d oc hi ri g  rafravaUa  media, 
or  infrared )  Wlh  tie  PF  serwr. 

A  the  Mesau  demonstrators ,  tour  H  HRs  transferred  receipfed 
dala  to  the  PP  dicing  palel  receipt  operators .  The  assessment 
team  compared  ire  count  cl  He  handwritten  inventory  list  to  ihe 
couiiotlheiPP  inventory  list.  TTiis  comparison  was 
accompished  at  dl  demonsfralons. 

A  the  C AAA  demonsfraf  on .  three  HHRs  transferred  receipted 
dala  to  ihe  PP  ddfng  palel  receipl  operators.  Mote.  The 
assessment  team  observed  technical  problems  allbeOAAA 
demonsfraton  Wth  tie  transfer  ot  receipted  data  trom  tie  HHR 
to  ihe  IFF. 

On  the  UBS  Fmoe,  tiree  HHRs  transferred  receipfed  data  to  tie 
PP  during  pallef  receipt. 

On  the  USB  Hairy  B  .Trursn .  tiree  out  of  four  HH  Rs  Iransfeired 
receipted  data  lo  tie  PP  during  pallet  receipt.  Feu  HHRs  wars 
■used  to  perform  tie  palel  issue.  The  wartghters  were  able  io 
update  the  pallef  count  and  tie  assessment  team  verified  Ihe 
pallet  count  changes  by  visual  in  spec  ton  ot  the  RF  tags  and  P  P. 
The  wartghfers  sided  ihecommuricdion  and  data  tansfer 
interface  Wti  Ihe  HHR,  RCU  and  PP  needed  some 
inprowments  to  increase  tie  reEability  and  accuracy. 

1.4.1 

1-4.3 

1.4.7 

23  HHR  Rjuincvabkj  Mumcry.Tba  HHR  Wil 
have  removable  data  storage  media  aucfi  as 
Hash  memory  cards , 

Mol  assessed.  The  HHR  did  nol  have  removable  dada  storage 
meda. 

2 .6  HHR  Multi  plu  RF  Tag  Anti-Lull  is  bn . 

The  HHR  shall  haw  an  eftedve  multpte  tag 
-signal  artkAkxi  lealures. 

The  assessment  team  observed  the  HHR  eld  nol  work:  it  tie 

RCU  was  interrogafng  RF  tagsal  tie  same  fme.  HHRs  would 
also  lock  up  il  anotier  HHR  was  in  close  proximily. 

1314 

2.7  H  HR  Transactions.  The  HHR  shal  haw 

ihe  ability  to  perlcitn  receipt,  but,  and 
iransfer  transactions  as  well  as  view  and 
change  asset  data  on  an  eristrig  tag. 

HHR  was  able  to  perform  panel  reoeipl,  pailel  issue,  Iransler 

Vansacion  records,  and  change  assel  data  on  tie  RF  tags. 

At  ihe  Messu  demonslratons.lcur  HHRs  tansterred  receipfed 
data  to. the  PP  dufng  palel  receipt  operator.  The  assessment 
team  compared  the  count  of  the  handwritten  inwnfory  list  to  Ihe 
count  of  ihe  !PP  inventory  list,  ibis  comparison  -was 
accompfshed  al  all  demonsfratons. 

A  the  C AAA  demonsfraf on .  three  HHRs  transferred  receipted 
dala  to  ihe  PP  ddlng  palel  receipl  operators.  Mote.  The 
assessment  team  observed  technical  probtems  allhe  CAAA 
demonstraton  Wth  tie  transfer  ot  receipted  data  Irom  tie  HHR 
to  Ihe  PR. 

On  the  USB  Ponce  ,  tiree  HHRs  transferred  receipfed  data  to  tie 
PP  during  pallef  reoeipf . 

On  the  USB  Hairy  S .  Truman ,  tiree  out  of  four  HHRs  transtened 
receipted  data  lo  tie  PP  during  pallet  receipt.  Feu*  HHRs  were 
used  toperlorm  tie  palel  issue  dufng  ihemarffme 
ctemonstrat on .  The  wartgMers  ware  able  to  update  the  pallef 
count  and  tie  assessment  team  writed  tie  pailel  count 
chances bv  visual  insoecton  of  ihe  RFlaos  and  PP. 

1.4.1 

2 S  H  MR  Barc^ yards.  Hi*  HHR  Shdl  haw 
sateguards  necessary  to  preserw  data  unffl 
successful  cornimunicafon  Wth  tie  PP. 

Mol  assessed 

2  3  H  H  R  H  E  RO  Cbimpl  ia  inti* .  The  HHR 
transmissions  will  be  Wtiin  HERO  compliant 

The  HHR  transmitter  power  was  24Q  mVV,  tial  met  tie 
requirements  lor  HE  RO . 

1312 

2.110  HHR  Future  Ousiyii.  Future  design  is 
lor  She  HHR  te  operate  in  any  military 
environment  worldwide. 

The  TECEVALdda  receded  tie  HHR  met  tie  ruggedness 
requiremente  stpulated  in  tie  FRD.  The  assessment  learn 
observed  no  HHR  failure  during  tie  demonstrators. 

2.62 
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■3.1  Inslallaliun.  The  RCU  Will  be  installed  On 
ammunilan  storage  and  maintenance 
laciilies  and  Jar  any  oilher  permanent 
approved  ammunilian  storage  lacafans.  [Far 
wwianr magaanes,  ilia  possible  lhad  toe 
RCU  be  moused  outside  and  toe  antenna 
cable  run  inside  the  magaane.]The  RCU 
may  be  hslaled  using  accessory  items,  such 
as  a  toped,  to  enable  ihe  RCU  to- be  installed 
in  field  environments. 

The  warfighters  irdicaled  ihe  lacadion  and  accessbility  eflhe 

RCU  were  acceptable  as  tong  as  you  have  ihe  rilraslructare 
■Scanduil  or  wooden  baardj  to  hang  Ihe  RCU  and  RFEs.  Tie 
wrqps  were  used  to  install  Ihe  RFEs  Wnile  toe  RC  Us  were 
maunted  an. a  portable  stand  ar  table. 

2M.t 

32  ArtlAMU  Cfcnffitf  unalksn.  Mullple 
antennas  Wll  be  Lfied  tar  coverage  el  large 
maga ares  and  lidd  storage  laciilies  il 
necessary. 

Ai  toe  Mesau  and  CAAAdemonstradions,  toe  RCU  was  able  la 
deleclal  leasl  33,5%  ar  233  RF  tegs  during  ihe  first  tolerragaliari 
cycle.  During  toe  second  and  Ihifd  interrogaloo  cy des,  ATD5 
was  able  to  deled  1 30-%  of  toe  RF  lags . 

Ad  marflme  demonsfalon,  RCU  was  able  todeteded  2G3  aulal 
2aa  RF  tags  an  ihe  uss  Harry  s.  Truman. 

1.10.1 

3,3  RCU  C6infnLjiiidart.ieris.  The  RCU  will 
inflate  hourly  oammunicadions  wito  Ihe  RF 
lags,  called  teg  ID,  and  any  limil  flags,  and 
transmit  tois  date  to  toe  PP  via  a  WLAN,  h 

1  -e  event  toial  a  WLAN  canneofon  is  Biel 
available  iram  toe  RCU  to  ihe  FP,  ihe  RCU 
will  have  ihe  capability  to  si  ere  3G  days  el 
date  from  all  lags  witoin  its  range  and  toansmil 
date  vrfien  canredivity  is  restored.  When  a 
WLAN  is  r'ril  carflguted  Or  nol available , 
cemmunicafen  between  toe  RCU  and  Ihe  PP 
is  achieved  via  dined  decking  wito  toe  HHIR. 

RCU  blerragaled  Ihe  RFIags  every  60  minutes 

Demanslradians  were  anear  two  weeks  long.  The  RCU  storage 
memory  capacity  was  256  h*.  The  assessmenl  learn  did  nol 
observe  a  date  storage  issue  during  toe  demanslradians,  bul 
mandmum  capacity  'was  not  assessed . 

1.3.1 

1 32 

tais 

■3.4  Fitter  Cimfiyunalbn.  The  RCU  Shal 
operate  frosts  en  VDC. 

As  long  as  toe  RCU  was  able  to  obtain  24  VDC  power,  toe  RCU 
was  able  to  operate  lawlessly. 

During  Ihe  demons  Ira  Ion,  Ihe  24  VDC  power  source  came  from 
portable  gas  electric  generator,  high  Mobility  Mullpurpczse 

Wheeled  vehicle  batteiy,  or  12a  VDC  line  pewer  using  a  24  VDC 
step  down  transformer. 

The  CAAA  logistics  E3ME  left  power  amiability  ad  remote  storage 
lacadians  wadd  be  a  major  concern.  Many  ot  these  magaanes 
will  not  have  toe  infteslrudd'eloharve  dedrical  power  la 
support  toe  HHR  and  RC  U  power  requirements. 

2.7.3 

2.75 

2.7.7 

3  3  WLAN  O  pa  rational  Ru  nyu .  WlANS  Will 

be  used  tor  date  transmission  between  toe 

RCU  and  toe  PR 

Ad  tie  Mesau  demonstoaton,  a.  line  at  sight  comedian  was 

estabished  Wlh  toe  earth-covered  magazine  and  P  P.  The 
dstence  between  iwiloeafonswds  approximately  less  toanan 
dghto  at  a  mile. 

Ad  toe  Crane  den  on  si  ration ,  toe  WlAN  ‘was  successluly 
canneded  la  a  repeater  an  top'  af  a  75  tool  wader  tower  to 
estehish  a.  mile  and  hall  camedon  la  toe  PP. 

Ad  bato  demonstration  sites,  toe  WLAN  was  able  to  provide 
reliable  cameclvitylram  toe  RCU  to  toe  PP. 

TXla 

3J5  RCU  Miulliplti  R.T  Tag  Anli  -to  IN  siun. 

The  RCU  shall  have  an  dtecfve  muHipie  RF 
lag  signal  anl-calisian  failure. 

The  assessmenl  team  observed  ihe  HHR  dd  nal  work  il  toe 

RCU  was  intenragafng  RF  tegs  al  toe  same  fme. 

13,14 

3.7  RCU  HERO  C^rnplia rite.  Thie  RCU 
Iransmissiens  will  be  Wtoin  HERD  eemplianl 
racialed  power  parameters. 

Thie  RCU  received  radtaled  energy  famthe  RFIags.  The  only 

RCU  transmission  came  from  Ihe  WLAN.  The  WLAN  power 
radiated  at  IQQmW  Eltedive  isotropic  Radated  Power,  ^rinich 
met  ihe  hero  nspmanfe 

1.4.4 

■3.3  RCU  Ruwudr*j?s.  The  RCUWil 
pertoim  fsi  a  leld  environment.  Te 
successfully  pertormin  ihe  leld  toe  RCU 
rnusl  be  sealed  lecemmercial  slandard. 

The  TEC  EVAL  dada  revealed  toe  RC  U  mel  toe  n^gedness 
requirements  slpuladed  in.  fie  FRD.  The  assessmenl  learn 
observed  iwa  RCU  tailutes  during  toe  demonstrations.  Cause 
tor  toe  lailures  has  nol  been  determined. 

2.6,3 
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Requirements 


Results 


MOP 


PP 

4.1  PP  Data  DtaS^niiialiOil.  The  PP  Will 

nvake  ass  el  dala  available  Is  Ser\ioe 

ammunition  AIS.  Environmental  dala  wil  be 
available  on  ne  EDH  £1  hdfin  Head  MD.Of 
oneroenVal  ntea.  Environmental  dais  will  be 
senl  to  tie  E  DH  by  way  el  seoui*  {l±fhM 
encrwlcn}  irriemelccnneclons. 

Hd  assessed 

42  F P  Data  ViSi bil ily  a ihJ  Access .  The  PP 
will  have  a  local  data  •Ji-e^jI Jry  capability-  Users 
will  be  able  toperlorm  userspedlied  dala 
queries  and  produce  ben  hard  copy  and  son- 
copy  reports  baaed  on  neae  queries.  Data 
access  and  manipulation  will  be  possible  only 
win  sy-slem  or  database  administrator  access 
privileges 

The  WAariigfifers  indicaled  lhal  using  ne  PP  display  was  easy. 

Ope ralcrs  were  able  1o  obtain  Ihe  inventory  and  Imnsadion 
inlormalon  needed  to  manage  ne  lagged  munilens  pallets. 

The  wariiffiters  staled  data  envy  on  ne  PP  was  easy  using  ne 
ijscr’-lrieridy  menus. 

±2.1 

2.7J, 2; 

EDB 

5.1  Emircifeineitlal  Dalaba^ti  Design.  The 

EDB  will  receive  aenserdala  Vom  PPs 
w<ori*vide  via  secure  {123-til  encryplenj 
Interne!  connecioris.  Da  la  will  be  accessed 
by  end  users  via  ne  same  means. 

Hd  assessed 

52  Lifetime  Dele  SliM  a^e.  The  EDB  Will 
have  ne  capability  store  data  torlheenlre 
lifecycle  d  each  lagged  nuiilen. 

Hd  assessed 

End  4&End 

S.l  System  Accuracy.  The  overall  system 
will  pass  accursle  dala  Vom  tine  Rflqgs  to 
ne  PP: 

RFlags  were  successful  in  Van  starring  assd  and  environment 
surveillance  dala  to  Ihe  PP. 

1.1.1 

1.12 

122 

124 

1.3,5 

5.1 .1  Dala  Vom  95%  el  RF  tags  reporting  lea 

reader  will  be  delected  by  ne  PFwinin  iwc 
ccnseculve  rcll  calls  {apprcarimaleiy  145 
minutes  based  on  hourly  allemplsMram  tie 
slarl  ofUvekMt  Data  Vom  99%  d  ne  RF  tags 
in  ne  leslmagaanee  will  be  delected  by  ne 

RP  winin  nree  consecutive  roll  calls 
{approrinvately  2 15  minutes  based  on  hourly 
aflempts )  Vo m  line  slarl  ol  ne  lesl. 

A1  ne  Mesau  demonslration,  ne  RCU  was  able  to  deled  199 

oulol2GQ  RF  tags  {94s%>  while  ihe  asp  RCU  delected  194  if 
lags  {97. 1%). 

Al  ne  crane  demonstialion.  ne  RCU  was  able  to  deled  l9r  oul 
d  2M  RFlags  {95 .5%  >  inside  ne  earih-ccwered  nvagazine  and 
storage  warehouse. 

.Al  ne  marilme  demonsvalon  on  ne  uss  HarFy  s .Truman,  ne 
RCU  was  able  1o  deled  2QG  oul  ol  200  RIF  lag  {100%  )  inside 
neshipnvagaSne. 

Al  2GG  RF  tagsw^ere  picked  up  during  ne  second  inlerrogalcn 
cycle. 

1.11.1 

1.112 
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Appendix _ 

Correlation  of 


Assessment  Questionnaires  to 
Environmental  Surveillance, 
Munitions  Management,  and 
Measures  of  Performance 
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The  fcllovvir.s  table  mapv  questionnaire  statements  to  en’.iiomnental  surveillance,  munition  management  and 
MOP:..  Note  that  the  Munition:  QA  tac.-k  is  not  included  in  die  table  because  it  was  not  assessed  during  the 
demon-:  trail  or.:.. 


Qu&stionnafra  Sfatsmsnt 

!| 

Millions  Malayan ent 

£ 

CE 

&B 

a  1 
1 1 
s 

« 

II 

1 

RJ|h  die  accepaHiry  a*RF  Brtperature  sertSOr. 

■ 

1  221 

Raa die accepaHiry 0*RF  ag relative hull  i  dry  sensor 

V 

1222 

Raw  die  teisbiiry  o' the  FT  sensors 

• 

1223 

Raa  die  cppab  aicy  re  charge  tieRF  tag  temperature  limits  'rom  die  reader . 

* 

1A1B 

RJ|h  tie  eppdbiity  r.j  .itunr  t*RF  ag  relativity*  limit. 

* 

1J3.17 

Rare  tie  £"0^  vane  as  o'  FT  o-airing. 

• 

ZJL1 

Rae  tie  e*ecd  vena  as  o'  FHR  a-airing. 

252 

Raa  tie  e**eed  vane  as  o'  RCU  rr  art  rig. 

252 

Rate  tie  e*acd vane as  o'  FT  Barling. 

25A 

Rare  tie  e**eed  vane  as  o'  tie  AIDS  n airing  mkAL 

255 

Rate  tie  accepaHiry  o1  tie  RF  Bg  location  capability. 

■ 

* 

4 

9 

4 

1.12 

Rate  (he  cppabiity  o'  tie  RF  ags  ro  execute  an  on-oammand  rep cwt. 

* 

• 

• 

* 

4 

123 

Rate  tie  cppabiityr  o'  tie  FT  ags-  to  execute  an  on-oammand  mamcry  leser. 

* 

1 .3.4 

Rate  die  accepaHiry  *a  visual  y  identi1 tying  the  RF  ags  urigue  idand'ieation  nunbar. 

V 

• 

* 

4 

1  25 

Rate  die  accepaHiry  o1  die  RF  ag  barcode  rwjiilnicy 

9 

* 

• 

m 

4 

1  27 

Rate  die  accepaHiry  o'  die  RF  ag's  low  battery  power  ind  cation. 

4- 

p 

P 

9 

4 

^29 

Rate  die  c^pabiityo*  die  FHR  crROJ  to  obtrindiaRFaguiiguaidancHcatioh. 

4 

* 

4 

1.3.18 

Rate  tie  accepaHity-  o1  ti-ans'etriag  FT  ag  data  a  FIFR  and  RCU. 

* 

4 

1  .3.19 

Rate  die  e'**activaneas  o'  daa  aans^er  lein  FHR  to  PP. 

■ 

* 

14.1 

R  ate  die  accepaHiry  o'  ImAifei  da  a  'rom  FIFR  or  RCU  to  tie  FT1. 

P 

4 

P 

p 

* 

1.4.7 

Rate  tie  accepaHity*  o'  die  ATOS  s yearn  b  support  data  tans^a  ^om  the  FHR  a  die  PP. 

* 

4 

1.4.1 

Rate  die  accepaHity*  o'  die  ATOS  system  a  support  data  frans'W  1-om  several  FT  tags  a 
theRCUarriPP. 

W 

9 

142 

Rate  die  accepaHity  o'  die  antenna  coverage  between  tie  FEU  and  die  FT  ag . 

* 

4 

*■ 

1.102 

Rate  tie  usability  o'  die  FHR  keypad. 

9 

4 

4 

9 

4 

1 .12.1 

Rate  tie  usability  or  die  FHR  stylus. 

* 

9 

4 

* ■ 

9 

1.122 

Rate  die  cppsbiity  o'  die  FHR  a  create  new  RF  rags. 

* 

1.13.1. 

Rate  die  cppabiiry  o'  die  FHR  a  create  replacement  RF  ags. 

1 

« 

4 

■ 

4 

1.132 

Raa  die  eppabiiry  o'  die  FHR  a  create  baoodes. 

■ 

i.iaa 

Rate  die  accepaHity  o'  die  RF  ag  attachments  a  die  containers. 

* 

Z.1J 

Rate  tie  usability  o'  die  HHR  dap  ay. 

# 

4 

4 

* 

4 

22.1 

Rate  die  FHR  daa  ippuc  usabiity. 

■ 

4 

• 

4 

222 

Raa  the  usability  o'  the  FHR-F3CU  bridge. 

* 

9 

4 

* 

9 

2J2J 

Rate  the  usability  o'  die  FHR-FP  bridge. 

* 

4 

4 

■ 

4 

224 

Rate  Be  usability  o'  die  FHR-FP  docking  sacion . 

* 

4 

4 

• 

4 

225 

Rate  die  usability  or  die  FT  d spay. 

* 

4 

4 

• 

22A 

Rate  die  FT  daa  \fpj.  usabiity-. 

■ 

* 

4 

■ 

222 

Rate  die  accepaHity  o'  con^guing  FT  csgs. 

* 

* 

P 

* 

4 

2.4.1 

Rate  Be  accepaHiry  o'  coring Liing  die  FIFR . 

4 

4 

■ 

4 

242 

Rate  die  accepaHity*  o'  ean^guing  the  ROJ . 

♦ 

■ 

4 

24,3 

Rate  tie  accepabiity  o'  cen^guing  die  PP. 

4 

• 

■ 

4 

244 

Raa  die  acoepabiity  o'  (he  RF  ag  power  re  gu  re  menus 

4 

4 

* 

2..TJS 

Raa  die  accepaHiry  o'  die  FIFR  and  RCU  power  requ  re  menus. 

* 

• 

* 

4 

■ 

2.T.T 

Raa  die  accepaHiry  o'  PP  power  requrements. 

• 

• 

4 

4 

* 

2.TJS 

Raa  die  accepaHiry-  o'  die  RCU  hstalackxs . 

* 

• 

* 

2JS.1 

Raa  die  accepaHiry  o'  the  PP  installation. 

• 

* 

4 

4 

* 

2.32 

Raa  die  accepaHiry  o'  (he  RF  teg  daa  storage  memory  cppadty. 

9 

4 

4 

P 

* 

1 .94 

Raa  die  accepaHity-  o'  die  FIFR  and  RCU  daa  storage  memory  e^padty. 

9 

• 

4 

4 

■ 

1 .9,5 

Raa  die  accepaHiry  o'  die  PP  daa  storage  capacity*. 

9 

■ 

4 

4 

■ 

TTl6 
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